datadrenaline
datadrenaline
  • Бейне 12
  • Рет қаралды 7 179
Extending Bitnami Spark Docker images for Apache Livy
CODE: github.com/dsynkov/spark-livy-on-airflow-workspace
I go over how to extend the existing Bitnami Spark Docker image to add support for Apache Livy (livy.incubator.apache.org/). This video is part of a series on setting up a development and experimentation environment for Apache Spark, Livy, and Airflow using Docker and docker-compose.
Рет қаралды: 913

Бейне

Running Scala Spark jobs on Bitnami Docker images
Рет қаралды 1,6 М. Жыл бұрын
CODE: github.com/dsynkov/spark-livy-on-airflow-workspace I go over how to configure the SparkSession for a Scala app running on a Docker Spark cluster using Bitnami Spark images (github.com/bitnami/bitnami-docker-spark). This video is part of a series on setting up a development and experimentation environment for Apache Spark, Livy, and Airflow using Docker and docker-compose.
Running PySpark jobs on Bitnami Docker images
Рет қаралды 4,5 М. Жыл бұрын
CODE: github.com/dsynkov/spark-livy-on-airflow-workspace An overview of how to set up a an Apache Spark cluster using Bitnami Spark Docker images (github.com/bitnami/bitnami-docker-spark) and run your first PySpark job. This video is part of a series on setting up a development and experimentation environment for Apache Spark, Livy, and Airflow using Docker and docker-compose.
Build your own SQL fiddle with Docker & Visual Studio Code
Рет қаралды 141 Жыл бұрын
A walkthrough on using Docker VSCode to set up a lightweight PostgreSQL environment. Code and docs below. Prerequisites are listed in the Github README. CODE: github.com/dsynkov/pg-sql-docker-fiddle BLOG POST: datadrenaline.medium.com/build-your-own-sql-fiddle-with-docker-vscode-88dfa54105fe The goal of this video is to demonstrate that spinning up an ephemeral database instance for ad-hoc quer...
Add authentication to your Dockerized PostgreSQL database
Рет қаралды 65 Жыл бұрын
Follow-up to our initial video on setting up a Dockerized Postgres DB. In this video we add authentication to our 'postgres' and 'docker' users. I recommend watching the prior video here (kzclip.net/video/-MzhW1892fE/бейне.html) before continuing. Prerequisites are listed in the Github README. CODE: github.com/dsynkov/pg-sql-docker-fiddle BLOG POST: datadrenaline.medium.com/build-your-own-sql-f...
Loading the AdventureWorks dataset with docker-compose
Рет қаралды 81 Жыл бұрын
This is the last video in a three-part series on working with PostgreSQL in Docker. Here we pivot to a the "AdventureWorks for Postgres" (github.com/lorint/AdventureWorks-for-Postgres) repo which serves as a great use of the concepts introduced earlier. If you're new to Docker I recommend starting with the first video (kzclip.net/video/-MzhW1892fE/бейне.html). Other videos in series: PART 1: kz...
Running PySpark jobs on Bitnami Docker images
Рет қаралды 4,5 М. Жыл бұрын
CODE: github.com/dsynkov/spark-livy-on-airflow-workspace An overview of how to set up a an Apache Spark cluster using Bitnami Spark Docker images (github.com/bitnami/bitnami-docker-spark) and run your first PySpark job. This video is part of a series on setting up a development and experimentation environment for Apache Spark, Livy, and Airflow using Docker and docker-compose.
Running Scala Spark jobs on Bitnami Docker images
Рет қаралды 1,6 М. Жыл бұрын
CODE: github.com/dsynkov/spark-livy-on-airflow-workspace I go over how to configure the SparkSession for a Scala app running on a Docker Spark cluster using Bitnami Spark images (github.com/bitnami/bitnami-docker-spark). This video is part of a series on setting up a development and experimentation environment for Apache Spark, Livy, and Airflow using Docker and docker-compose.
Extending Bitnami Spark Docker images for Apache Livy
Рет қаралды 913 Жыл бұрын
CODE: github.com/dsynkov/spark-livy-on-airflow-workspace I go over how to extend the existing Bitnami Spark Docker image to add support for Apache Livy (livy.incubator.apache.org/). This video is part of a series on setting up a development and experimentation environment for Apache Spark, Livy, and Airflow using Docker and docker-compose.
Build your own SQL fiddle with Docker & Visual Studio Code
Рет қаралды 141 Жыл бұрын
A walkthrough on using Docker VSCode to set up a lightweight PostgreSQL environment. Code and docs below. Prerequisites are listed in the Github README. CODE: github.com/dsynkov/pg-sql-docker-fiddle BLOG POST: datadrenaline.medium.com/build-your-own-sql-fiddle-with-docker-vscode-88dfa54105fe The goal of this video is to demonstrate that spinning up an ephemeral database instance for ad-hoc quer...
Loading the AdventureWorks dataset with docker-compose
Рет қаралды 81 Жыл бұрын
This is the last video in a three-part series on working with PostgreSQL in Docker. Here we pivot to a the "AdventureWorks for Postgres" (github.com/lorint/AdventureWorks-for-Postgres) repo which serves as a great use of the concepts introduced earlier. If you're new to Docker I recommend starting with the first video (kzclip.net/video/-MzhW1892fE/бейне.html). Other videos in series: PART 1: kz...
Add authentication to your Dockerized PostgreSQL database
Рет қаралды 65 Жыл бұрын
Follow-up to our initial video on setting up a Dockerized Postgres DB. In this video we add authentication to our 'postgres' and 'docker' users. I recommend watching the prior video here (kzclip.net/video/-MzhW1892fE/бейне.html) before continuing. Prerequisites are listed in the Github README. CODE: github.com/dsynkov/pg-sql-docker-fiddle BLOG POST: datadrenaline.medium.com/build-your-own-sql-f...