Modern Data Stack

Setup a Modern Data Stack in 3 Easy Steps

Modern Data Stack by Joey Taleno

Here are the steps you can follow:

  1. Choose a Cloud Service Provider. Below are the only options because those are what currently supported by plural.sh in step 2.
  2. Install plural.sh to your Cloud Service Provider of choice from step 1. Here’s their getting started guide for your convenience. But you ask, what is plural.sh? Plural.sh is this amazing tool to easily deploy Open Source Softwares which includes installation of dependencies, maintenance and infrastructure scaling on Kubernetes (which I don’t know about to be honest). Once done, install the following apps:
    • Airbyte is for Data Ingestion. Get your source data to your data warehouse in minutes.
    • Metabase is for Data Visualization or Business Intelligence. Create beautiful dashboards in minutes.
    • Other Data Engineering & Analytics tools like Airflow and Superset.
  3. Subscribe to a Cloud Data Warehouse & Data Modeling Tool. I think this is the heart & soul of this modern data stack. Without this or if this part stops beating / functioning right, data quality & business insights will surely be compromised.
    • Snowflake is for Cloud Data Warehouse. Do I need to say more about Snowflake? I think they are one of the best. A no-brainer.
    • dbt Cloud is for Data Transformation or Data Modeling. This is like a breath of fresh air to me. dbt makes it easy for my Data team to have smooth workflow so we can deliver data models fast.