Validate Your DataFrames Using Pandera | Scalable Pandas Meetup 6 скачать в хорошем качестве

Validate Your DataFrames Using Pandera | Scalable Pandas Meetup 6

Niels Bantilan presents on Pandera, an open-source data testing library for dataframe-like objects. Chapters: 0:00 Agenda + meetup background 1:38 Introducing Niels Bantilan 3:04 Introducing Pandera 4:42 Data validation + data testing 7:32 Pandera demo 15:37 Q: What was the most challenging part of building out Pandera? 17:48 Q: Is there a particular background for a Pandera open-source contributor that would be especially helpful? 20:16 Q: What are some learnings on the different kinds of dataframes? 23:26 Q: When should someone use Pandera, Great Expectations, or dbt? 27:37 Q: What is a good use case for getting started with Pandera? 31:13 Q: What interpersonal problems does data validation help with in a sprawling organization? 33:58 Q: What is your vision for Pandera in 5 years? 36:39 How Pandera and Hamilton work together 37:37 Q: Is there a general representation of a schema that can be passed between tools?