Skip to main content

MacOS

Requirements

MacOS 14.4 or later

Prerequisites

Before you can run the Datorios client, you should have the following prerequisites installed:

  1. Command line tools

    Install the necessary command line tools using Homebrew:

    brew install curl jq

  2. Install Docker Desktop Download and install Docker Desktop for Mac from the official Docker website:

Mac

Installation Steps

  1. Extracting the client

  • Download the Datorios client tar gz file for your specific version (datorios.tar.gz).

  • Unzip the downloaded client: tar zxvf datorios.tar.gz

  • Change the datorios.sh file attribute to executable: chmod +x datorios.sh

  1. Configure Environment Variables

  • Locate the .env file inside the unzipped folder you downloaded. (Note: .env may be hidden - use Command+Shift+. (period) to show hidden files).

  • Open this in your favorite text editor to configure environment variables for mounting your Flink jar files.

  • Variables for Mounting Flink Jar Files --MOUNT_SRC_PATH: Path to the local directory containing your Flink jar files (any number of jar files including sub-folders). This is the path to the directory on your physical machine where the actual jars are saved.

--MOUNT_DST_PATH: Mount point for the Flink jar files directory inside the Docker container. This is the path within Docker that refers to the MOUNT_SRC_PATH. See how to use it in Run Flink Jobs.

Example .env Configuration MOUNT_SRC_PATH=/home/jars

MOUNT_DST_PATH=/flink_jobs

Note: To update the MOUNT_SRC_PATH edit the .env file and restart the cluster.

For more information, see the Run Flink Jobs section below.

  1. Fetch Datorios Client Images
  • To fetch the latest images of the Datorios client, run the following command: ./datorios.sh fetch
  1. Start Flink Cluster
  • To start a new Flink cluster, run the following command, replacing [cluster-name] with your desired name: ./datorios.sh [cluster-name] start

Example: ./datorios.sh my-cluster start

  1. Listing Cluster Status
  • Check the status of your running clusters: ./datorios.sh list Example Output: NAME STATUS CONFIG FILES datorios-my-cluster running(4) /home/user1/datorios/docker-compose.yml

Note: When addressing your cluster, remove the Datorios prefix from the NAME.

  1. Run Flink Jobs
  • Use the configured environment variables (MOUNT_SRC_PATH and MOUNT_DST_PATH) to specify the location of your Flink jar files within the container.
  1. **Run the Flink jobs using the following command: ./datorios.sh my-cluster flink run /MOUNT_DST_PATH/job_name.jar

my-cluster: As defined in section 4

  • MOUNT_DST_PATH: As defined in section 2
  • job_name.jar: As it was saved on the MOUNT_SRC_PATH

Examples: ./datorios.sh my-cluster flink run /flink_jobs/CarData.jar

./datorios.sh my-cluster flink run /flink_jobs/JetPlaneData.jar

  1. Stop Flink Cluster
  • To stop a running cluster, run: ./datorios.sh [cluster-name] stop

Example: ./datorios.sh my-cluster stop

Following these steps should have your Datorios environment up and running. If you encounter any issues, refer back to the documentation for the prerequisites or reach out to our support team for assistance.

Welcome to Datorios, and happy data processing!