Welcome to the Arcion demo kit. Arcion replicates data from one platform to another. The demo kit make it easy to see Arcion in action.

Install the Demo Kit

Cut and paste the following in a terminal.

• run the latest

  /bin/bash -c "$(curl -k -fsSL https://raw.githubusercontent.com/databricks/docker-dev/refs/heads/main/install.sh)"
  

Recording of the Demos

Arcion supports snapshot, real-time, snapshot, and delta-snapshot replication modes. Arcion can be run from CLI and UI.

Recorded Arcion CLI demos of source, destination, and replication type combination are available. The CLI recordings use asciiinema. YAML config files used are display. This is a functional demo using TPCC and YCSB.

• Left side of the table (the left column) is the source.
• Right side of the table (the top row) is the destination.
• The cell has workloads and URL to the demo.
• A blank cell means a demo has not been recorded as of yet.

Snapshot Replication CLI Demos

• C=TPCC
• Y=YCSB
• CY=TPCC and YCSB

snapshot	cockroach	Google CloudSQL MySQL	kafka	minio	mysql	null	oracle	pg	redis stream	single store	snow flake	sql edge	sql server	yuga byte
db2	CY			CY		CY CY				CY			CY
db2 luw			CY	CY	CY	CY	CY	CY	CY		CY
informix	CY		CY	CY CY	CY	CY CY	CY	CY	CY	CY	CY		CY
mariabd	CY
mysql	CY	CY	CY	CY CY	CY	CY CY	CY	CY	CY	CY	CY		CY
oracle			CY	CY	CY	CY	CY	CY	CY		CY
oraee	CY			CY		CY				CY			CY
pg	CY		CY	CY CY	CY	CY CY		CY		CY	CY		CY
single store	CY			CY		CY				CY			CY
sql edge	CY			CY		CY				CY			CY
sql server	CY CY			CY		CY				CY			CY
sybase ase	CY		CY	CY	CY	CY		CY	CY	CY		CY	CY	CY

Full Replication CLI Demos

full	databricks	Google Cloud Storage	Google CloudSQL MySQL	kafka	minio	mongodb	mysql	null	oracle	pg	redis stream	singlestore	snowflake	sqlserver
db2 luw							TPCC YCSB		TPCC YCSB	TPCC YCSB
IBM Db2									various
informix				YCSB	YCSB		YCSB	YCSB	YCSB,YCSB	YCSB,YCSB	YCSB		YCSB
mongodb
mysql	various	TPCC YCSB	TPCC YCSB	TPCC YCSB	TPCC YCSB		TPCC YCSB,TPCC & YCSB,TPCC & YCSB	TPCC YCSB	TPCC YCSB	TPCC YCSB	TPCC YCSB	various
oracle				TPCC YCSB,TPCC YCSB	TPCC YCSB	various,	TPCC YCSB	TPCC YCSB	various	TPCC YCSB		various	YCSB,
pg				YCSB	YCSB		YCSB		X	YCSB	YCSB			YCSB
snowflake														various

UI Videos

Snapshot Replications

full	confluent cloud	databricks	databricks delta lake	S3	mongodb	postgresql	singlestore
mysql	video	Voiceover		video		video	video
oracle		video video	video		video	video
sql server		Voiceover

Full Replications

snapshot	S3	postgresql	snowflake
cloud sql mysql	video	video	video
cloud sql postgresql		video	video

About the Arcion demo kit

The diagram below describes the components of the demo kit. Please refer to https://docs.arcion.io for more info.

• Load Generator
• Data source
• Arcion host with dedicated metadata database
• Data destination

Prerequisites

Assumptions:

• Running on Windows WSL2, Liunx or Mac
  • Intel CPU can run all databases
  • Apple Silicon cannot run Oracle
• Have Arcion License or replicant.lic
  • replicant.lic file in the current directory
  • ARCION_LICENSE env variable
• Have Docker 19.3.0 or above
• Have docker compose or docker-compose
• Have git installed
• Have access to a terminal
• Have access to a browser

Run specific tag for testing

export ARCION_WORKLOADS_TAG=23.07
/bin/bash -c "$(curl -k -fsSL https://raw.githubusercontent.com/databricks/docker-dev/refs/heads/{ARCION_WORKLOADS_TAG:-main}/install.sh)"

Group

• Source
• Target