How to use Spark in Microsoft Fabric - YOUR QUESTIONS ANSWERED (30 of 30) скачать в хорошем качестве

How to use Spark in Microsoft Fabric - YOUR QUESTIONS ANSWERED (30 of 30)

Learn Apache Spark in Microsoft Fabric in the 30 days of September. Here's the playlist for this series if you want to catchup:    • Learn Apache Spark in Fabric in 30 days   Learning Spark (free) eBook: https://pages.databricks.com/rs/094-Y... Link to the GitHub for this series: https://github.com/LearnMicrosoftFabr... Spark is the engine behind both the Data Engineering AND the Data Science experiences in Microsoft Fabric, so in September I'll be walking you through Apache Spark: what it is, why you should learn it, how to use it, and how it integrates into Microsoft Fabric. No previous Spark knowledge is required, some basic Python would be useful! #pyspark #microsoftfabric #apachespark Here's the schedule: 1 Welcome -    • DAY ONE - Learn Apache Spark in Microsoft ...   2 Why Spark?    • Why you should learn Spark in Microsoft Fa...   3 Components of Spark -    • FIVE components of the Spark engine in Mic...   4 Spark DataFrame -    • Introducing the Spark DataFrame in Microso...   5 Read Files into DataFrame -    • How to read CSV, JSON, PARQUET into Spark ...   6 Read/Write to Lakehouse Table -    • How to write data to Lakehouse Table in Mi...   7 Basic DataFrame Operations -    • Learn THESE important pySpark operations F...   8 DataFrame Filtering -    • 14 ways to filter your Spark DataFrame in ...   9 GroupBy and Aggregate Functions -    • How to use GROUPBY and AGG functions in py...   10 Handling missing values -    • NO MORE NULLS - how to handle missing valu...   11 Joining DataFrames -    • How to get better insights by JOINING Spar...   12 Time-series data -    • Analyzing DATES and TIMES in Spark in Micr...   13 Spark SQL -    • Using your SQL knowledge in Spark in Micro...   14-16 Spark Machine Learning -    • Spark Machine Learning End-To-End Project ...   20 Configuring Spark -    • Customising Fabric Runtime and Spark in Mi...   21 Autotuning Spark Configuration -    • Autotuning your Spark config in Microsoft ...   22 Library Management -    • Manage your Python packages (the old way) ...   23 High-concurrency mode -    • Running multiple notebooks on same session...   24 Spark Scala -    • Writing Spark Scala in Microsoft Fabric No...   25 Fabric MSSparkUtils -    • Powerful notebook utility functions (MSSpa...   26 Monitoring Spark -    • Monitoring Spark (errors and cost) in Micr...   30 FINALE QnA - THIS VIDEO Timeline 0:00 Recap & Intro 2:20 Q1: Spark SQL 5:07 Q2: Pandas DF vs Spark DF 9:17 Q3: mergaSchema 12:46 Q4: SQL import 13:10 Q5: withColumnRenamed 14:52 Q6: Imputer 16:52 Q7: ML 17:55 Q8: Day 17-19 18:49 Q9: Reading Changing Files 20:30 Other resources: Fabric Espresso 21:31 Learning Spark 23:26 Series roundup -BROWSE MY OTHER FABRIC PLAYLISTS- DATA ENGINEERING    • Data engineering (Microsoft Fabric)   END-TO-END FABRIC PROJECT    • Плейлист   INTRO TO MICROSOFT FABRIC    • Intro to Microsoft Fabric   DATA FACTORY    • Data Factory (Microsoft Fabric)   -LINKEDIN- Not following the LinkedIn page yet? Here's the link:   / learnmicrosoftfabric   -ABOUT WILL- Hi, I'm Will! I'm hugely passionate about data and using it to create a better world. I currently work as a Consultant, focusing on Data Strategy, Data Engineering and Business Intelligence (within the Microsoft/Azure/Fabric environment). I have previously worked as a Data Scientist. I started Learn Microsoft Fabric to share my learnings on how Microsoft Fabric works and help you build your career and build meaningful things in Fabric. -SUBSCRIBE- Not subscribed yet? You should! There are lots of new videos in the pipeline covering all aspects of Microsoft Fabric. https://youtube.com/@learnmicrosoftfa...