Published On Apr 21, 2024
Enroll in the Apache Spark Course Here - https://datavidhya.com/courses/apache
USE CODE: EARLYSPARK for 50% off
➡️ Combo Package Python + SQL + Data warehouse (Snowflake) + Apache Spark: https://com.rpy.club/pdp/yYnEMzLOX?pl...
USE CODE: COMBO50 for 50% off
In this video, we are going to analyze IPL data by building a data pipeline, main focus of this video is to focus on writing Apache Spark code and different functions to perform transformation,
Code used in the video: https://github.com/darshilparmar/ipl-...
Dataset Link - https://data.world/raghu543/ipl-data-...
Timestamps
0:00 Introduction
0:31 Architecture Diagram and Spark Basic Concepts
13:26 Understand the Dataset
21:07 Complete Project Execution
01:18:32 Final Words
👦🏻 My Linkedin - / darshil-parmar
📷 Instagram - / datawithdarshil
🎯Twitter - / parmardarshil07
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
3 Books You Should Read
📈Principles: Life and Work: https://amzn.to/3HQJDyP
👀Deep Work: https://amzn.to/3IParkk
💼Rework: https://amzn.to/3HW981O
Tech I use every day
💻MacBook Pro M1: https://amzn.to/3CiFVwC
📺LG 22 Inch Monitor: https://amzn.to/3zk0Dts
🎥Sony ZV1: https://amzn.to/3hRpSMJ
🎙Maono AU-A04: https://amzn.to/3Bnu53n
⽴Tripod Stand: https://amzn.to/3tA7hu7
🔅Osaka Ring Light and Stand: https://amzn.to/3MtLAEG
🎧Sony WH-1000XM4 Headphone: https://amzn.to/3sM4sXS
🖱Zebronics Zeb-War Keyboard and Mouse: https://amzn.to/3zeF1yq
💺CELLBELL C104 Office Chair: https://amzn.to/3IRpiL2
👉Data Engineering Complete Roadmap: • Data Engineer Complete Road Map 2022
👉Data Engineering Project Series: • Data Engineering Project Portfolio
👉Become Full-Time Freelancer: • Best Freelancer Series 2024
👉Data With Darshil Podcast: • Podcast Series - Data With Darshil
✨ Tags ✨
✨ Hashtags ✨
#dataengineering #apachespark #databricks