Real-time transaction categorization w/ Bayesian feedback loop - Tijl Kindt | PyData Eindhoven 2021 скачать в хорошем качестве

Real-time transaction categorization w/ Bayesian feedback loop - Tijl Kindt | PyData Eindhoven 2021

As part of our personal finance management functionality, ING categorises transactions in real-time for customers that want to get insight into where they are spending their money. In this talk for anybody who would like to be inspired by a real-life, large-scale data science use case, I’ll elaborate on 1) the tools and constraints within which we are operating, 2) how we bootstrapped the algorithm, so we could go live to customers with acceptable quality, and 3) the Bayesian-inspired functionality that we created to make this categorisation algorithm self-learn from the feedback from those customers. The system, which was developed in-house, is split into a batch part and a real-time part. The batch part was written in PySpark and uses both implicit and explicit feedback from customers to tweak the predicted category for each counterparty. We use Bayesian inference to assess probabilities and bandits to provoke more varied feedback from customers. The real-time part uses the information from the batch part to categorise the transactions as they happen using Apache Flink and PMML. In this talk I hope to inspire you to make the most of the tools you have available, and get your hands dirty with streaming analytics and to convince you that you don’t need deep learning to change the lives of your customers for the better. Tijl Kindt: a senior data scientist at ING Bank in the Netherlands. After obtaining a Bachelor's degree in Astronomy, and a Master's degree in Media Technology with a thesis on predicting mood in the context of movie recommendations, he joined ING in 2013, where he worked for 3 years on marketing models with SAS. Since then he's been focusing on customer-facing data products that help customers manage their money, such as Kijk Vooruit (Look Ahead) and Inzicht (Insight). LinkedIn:   / tijlk   PyData Eindhoven 2021 Website: https://pydata.org/eindhoven2021/ Twitter:   / pydataeindhoven   === www.pydata.org PyData is an educational program of NumFOCUS, a 501(c)3 non-profit organization in the United States. PyData provides a forum for the international community of users and developers of data analysis tools to share ideas and learn from each other. The global PyData network promotes discussion of best practices, new approaches, and emerging technologies for data management, processing, analytics, and visualization. PyData communities approach data science using many languages, including (but not limited to) Python, Julia, and R. PyData conferences aim to be accessible and community-driven, with novice to advanced level presentations. PyData tutorials and talks bring attendees the latest project features along with cutting-edge use cases. 00:00 Welcome! 00:10 Help us add time stamps or captions to this video! See the description for details. Want to help add timestamps to our YouTube videos to help with discoverability? Find out more here: https://github.com/numfocus/YouTubeVi...