Python ETL Data Pipeline Tutorial with AWS, Terraform and Spotify скачать в хорошем качестве

Python ETL Data Pipeline Tutorial with AWS, Terraform and Spotify

How to use data engineering skills to create an ETL data pipeline for Spotify data. In this video, I go over how to create a Python script that requests data from the Spotify API, loads this data into a data lake (S3 on AWS) via a Lambda function (serverless computing on AWS) and the entire solution is deployed using Terraform (except for the S3 bucket, sorry). This database can be used for future analysis of listening habits and trends. My Website: https://www.liamhartley.co.uk My TikTok:   / datadrivendecisions   My Blog:   / liamjhartley   My Instagram:   / liamhartley.co.uk   GitHub: https://github.com/liamhartley/spotif... Python: https://www.python.org/downloads/ Terraform: https://www.terraform.io/downloads.html Spotify Developers Guide: https://developer.spotify.com/documen... Spotify (Register App): https://developer.spotify.com/documen... SpotiPY: http://spotipy.readthedocs.io/ Project Article: https://python.plainenglish.io/how-to... Buy me a coffee! https://www.buymeacoffee.com/liamhartley 00:00 - Intro 01:41 - Pre-Requisites 04:59 - Extract and Transform with Python 14:20 - Loading with Lambda & AWS 18:38 - Terraform Deployment 29:13 - Summary