Skip to main content

Installation and Quick Setup

Getting started with Datorios is straightforward. Follow these steps to quickly deploy the observability layer and integrate it with your Apache Flink environment:

Components of Datorios​

Datorios Client:​

  • Runs on Docker Compose.
  • Installs the Apache Flink engine on your local or cloud machine to deploy your jobs.

Observability Service:​

  • Provides deep investigation and debugging capabilities.

Installation Steps​

1. Download and Extract the Client:​

  1. Download the datorios.tar.gz file for your version.
  2. Extract the archive: 
    tar zxvf datorios.tar.gz
  3. Set the script as executable: 
    chmod +x datorios.sh

2. Configure Environment Variables:​

  1. Open the .env file and configure:
    • MOUNT_SRC_PATH: Local directory containing your Flink jar files.
    • MOUNT_DST_PATH: Mount point inside the Docker container.
  2. Example: 
    MOUNT_SRC_PATH=/home/jars
    MOUNT_DST_PATH=/flink_jobs

3. Fetch the Datorios Client Images:​

Run the following command:

./datorios.sh fetch

4. Start a Flink Cluster:​

Use the command:

./datorios.sh <cluster-name> start

Example:

./datorios.sh my-cluster start

5. Run Flink Jobs:​

  1. Specify the job path using the configured environment variables.
  2. Use the command: 
    ./datorios.sh <cluster-name> flink run /MOUNT_DST_PATH/job_name.jar

6. Stop a Flink Cluster:​

Use the command:

./datorios.sh <cluster-name> stop

Verification​

Check the cluster status with:

./datorios.sh list