Dashboard Podcasts Screencasts Courses Coaching Calendar

Adventures in Machine Learning

Machine Learning is growing in leaps and bounds both in capability and adoption. Listen to our experts discuss the ideas and fundamentals needed to succeed as a Machine Learning Engineer.

Subscribe

Follow

Rethinking ML Monitoring - ML 060

Hosts :

Published : Feb 03, 2022

Duration : 35 Minutes

Show Notes

Mo’ advancements mean mo’ problems, and today, Michael and Ben are diving into the biggest issues of ML monitoring in 2022. They lay out the ELEVEN (cause nothing good comes easy) potential pitfalls that you should know this year, the important questions that you NEED to ask yourself before launching your baby, and this ONE phenomenon that reveals a fundamental flaw in models versus the real deal.

In This Episode

The checklist of ELEVEN problems with ML monitoring that you need to consider in 2022
Why THIS is inevitable with ML monitoring no matter what (and why it’s not the end of the world…unless you make it)
Before you make an assumptions about your model, ask yourself THESE questions and tread carefully
This ONE phenomenon that reveals a HUGE flaw in models vs. real world

Sponsors

Sponsored By:

Adventures in Machine Learning Rethinking ML Monitoring - ML 060
Adventures in Machine Learning AI in Education: From Micro-Courses to Rigorous Training Programs - ML 162
Adventures in Machine Learning AI Deployment Simplified: Kit Ops' Role in Streamlining MLOps Practices - ML 159
Adventures in Machine Learning Ask Me Anything (AMA) with Host Ben Wilson - ML 078
Adventures in Machine Learning ML 014: Deep Learning with Structured Data with Mark Ryan
Adventures in Machine Learning ML 010: Brains, Guitars, and JavaScript with Milecia McGregor
Adventures in Machine Learning Delivering Scoped Solutions: Lessons in Fixing Production System Issues - ML 144
Adventures in Machine Learning Rethinking ML Monitoring Part 2 - ML 063
Adventures in Machine Learning AI-Powered Tools for Productivity with Artem Koren - ML 169
Adventures in Machine Learning BONUS: How to get Freelance Clients to Come to You
Adventures in Machine Learning Business Infrastructure in ML with Joe Reis - ML 065
Adventures in Machine Learning ML 016: Python as a Basis for Machine Learning with Ken Youens-Clark
Adventures in Machine Learning BONUS: Measuring Apps and Entrepreneurship with John-Daniel Trask
Adventures in Machine Learning The Intersection of Success and Talent Retention in Software Development - ML 156
Adventures in Machine Learning Maintaining Backward Compatibility in Software Projects: Strategies from Industry Experts - ML 164
Adventures in Machine Learning Data Feeds and KDNuggets with Maria Zentsova - ML 064
Adventures in Machine Learning BONUS: Continuing Your Learning Journey by Finding Mentors as an Influencer
Adventures in Machine Learning Solving the Real Issues with the MLflow Team - ML 059Weichen Xu
Adventures in Machine Learning Unraveling the Complexities of Model Deployment in Dynamic Marketplaces - ML 151
Adventures in Machine Learning How to Test ML Code - ML 091
Adventures in Machine Learning How to Simplify Data Science with DagsHub Founders - ML 092
Adventures in Machine Learning How AI and Deep Fakes Are Transforming Security and Customer Trust - ML 160
Adventures in Machine Learning Data Platform Innovation: Navigating Challenges and Building a Unified Experience - ML 147
Adventures in Machine Learning ML 024: Machine Learning in Action with Ben Wilson
Adventures in Machine Learning Automated Machine Learning with Qingquan Song - ML 030
Adventures in Machine Learning The Journey to Expertise with Fernando Lopez - ML 152
Adventures in Machine Learning Wars of AI and Justice: Handling Uncertainties and Ethical Quandaries - ML 137
Adventures in Machine Learning AutoML Discovery and Approach - ML 070
Adventures in Machine Learning Navigating Expertise Gaps - ML 172
Adventures in Machine Learning Peer Review and Career Development - ML 173
Adventures in Machine Learning Complex ML Models with Data Scientist Fernando Lopez - ML 089
Adventures in Machine Learning How to Teach Kids Science with Kathryn Hulick - ML 066
Adventures in Machine Learning The MLOps Community with Demetrios Brinkmann - ML048
Adventures in Machine Learning Tools, Tricks, and Learning in Machine Learning ft. Aliaksei Mikhailiuk - ML 054
Adventures in Machine Learning Training Bots, The Stock Market, and Hypotheticals - ML 067
Adventures in Machine Learning Mentorship in Machine Learning - ML 038
Adventures in Machine Learning BONUS: How to do LARGE Volumes of HIGH Quality Work - While Spending Fewer Hours Working
Adventures in Machine Learning How to Get Started in Machine Learning - ML 034
Adventures in Machine Learning 3 Fundamental Pillars You Need to Succeed as an Entrepreneur - BONUS
Adventures in Machine Learning ML 006: Mad Science AI with Benson Ruan
Adventures in Machine Learning Bioinformatics and Programming with Ken Youens-Clark - ML 082
Adventures in Machine Learning Tensorflow.js with Gant Laborde - ML 028
Adventures in Machine Learning BONUS: Continuing Your Learning Journey by Finding Mentors as an Influencer
Adventures in Machine Learning ML 025: Machine Learning and Quantum Computing with Ather Fawaz
Adventures in Machine Learning ML 026: Sweetviz with Francois Bertrand
Adventures in Machine Learning MLflow 2.0 And How Large-Scale Projects Are Managed In The Open Source - ML 096
Adventures in Machine Learning BONUS: How Opportunities Come Your Way When You're an Influencer
Adventures in Machine Learning BONUS: How to Crush Your Biggest Goals in 2021
Adventures in Machine Learning BONUS: How to do LARGE Volumes of HIGH Quality Work - While Spending Fewer Hours Working
Adventures in Machine Learning All Things Machine Learning - ML 115
Adventures in Machine Learning Data Watchdogs - ML 133
Adventures in Machine Learning Exploratory Data Analysis (EDA) in Machine Learning - ML 075
Adventures in Machine Learning Cows, Camels, and the Human Brain - ML 058
Adventures in Machine Learning Data + ML: What Could Go Wrong? ft. Sandeep Uttamchandani - ML 043
Adventures in Machine Learning Deploying Your Machine Learning Models with FastAPI ft. Ahmad Mustafa Anis - ML 050
Adventures in Machine Learning Where ML and DevOps Meet - ML 108
Adventures in Machine Learning Machine Learning for Movie Scripts - ML 106
Adventures in Machine Learning How To Recession Proof Your Job - BONUS
Adventures in Machine Learning ML 022: Machine Learning with TensorFlow Chris Mattmann
Adventures in Machine Learning Important Questions To Ask When Scoping ML Projects - ML 094
Adventures in Machine Learning ML 005: Transfer Learning for NLP with Daniel Svoboda
Adventures in Machine Learning How does Search Work? - ML 118
Adventures in Machine Learning The Role of Open Source in Modern Development Practices - ML 170
Adventures in Machine Learning A/B Testing with ML ft. Michael Berk - ML 053
Adventures in Machine Learning ML 021: Grokking Deep Reinforcement Learning with Miguel Morales
Adventures in Machine Learning ML 013: Recommender Systems with Frank Kane
Adventures in Machine Learning Writing Production Code for ML ft. Ken Youens-Clark - ML 041
Adventures in Machine Learning The Impact of Process on Successful Tech Companies - ML 145
Adventures in Machine Learning Monitoring and Evaluating Data Sets ft. Emeli Dral and Elena Samuylova - ML 049
Adventures in Machine Learning Time Series Models in Machine Learning - ML 087
Adventures in Machine Learning ML 008: TensorFlow.js and YOU with Jason Mayes
Adventures in Machine Learning Business Objectives and KPIs with Michael Berk
Adventures in Machine Learning The Best Machine Learning Frameworks and Tensorflow Extensions with Derrick Mwiti - ML 031
Adventures in Machine Learning ML 023: Inside Machine Learning with Edward Raff
Adventures in Machine Learning Learning, Testing, and Mentorship: Building Autonomy and Confidence in Python Development - ML 167
Adventures in Machine Learning AGI, Neuron Simulators, and More with Charles Simon - ML 090
Adventures in Machine Learning BONUS: Relationships Matter Most
Adventures in Machine Learning Using AI and ML to Help Humans, Not Replace Them - ML 071
Adventures in Machine Learning Transforming Recruitment with AI: Surveys, Sentiment, and Data-Driven Insights - ML 161
Adventures in Machine Learning AI in Security: Revolutionizing Defense and Outsmarting Attackers in the Digital Era - ML 153
Adventures in Machine Learning Productionized Machine Learning Engineers featuring Laszlo Sragner - ML 037
Adventures in Machine Learning Testing Your MLOps - ML 051
Adventures in Machine Learning The 3 Essentials for Successful Job Outcomes - BONUS
Adventures in Machine Learning Scaling video processing with Deep Learning - ML 033
Adventures in Machine Learning Distributed Time Series in Machine Learning - ML 088
Adventures in Machine Learning ML 003: Your GPU Brain with Robert Plummer
Adventures in Machine Learning Should you Context Switch when Writing Code? - ML 095
Adventures in Machine Learning The Impact of Generative AI on the Advertising Industry - ML 168
Adventures in Machine Learning Machine Learning: More than Just an Algorithm - ML 035
Adventures in Machine Learning ML 011: History of AI in the UK with Laurence Moroney
Adventures in Machine Learning Harnessing Open Source Contributions in Machine Learning and Quantization - ML 148
Adventures in Machine Learning ML 004: Automated Machine Learning ML with Jorge Torres
Adventures in Machine Learning How To Do Research Spikes - ML 093
Adventures in Machine Learning ML 015: Extracting Value from Data with Alexey Grigorev
Adventures in Machine Learning The 3 Essentials for Successful Job Outcomes - BONUS
Adventures in Machine Learning Part 2: Exploratory Data Analysis (EDA) Next Steps - ML 076
Adventures in Machine Learning Accurate Predictive Modeling with Maarit Widmann - ML 061
Adventures in Machine Learning ML 002: DeOldify Your Life with Jason Antic
Adventures in Machine Learning Machine Learning for the Mars Rover with Annie Didier - ML 029
Adventures in Machine Learning Hyperparameter Tuning for Machine Learning Models - ML 079
Adventures in Machine Learning ML 012: Machine Learning for Mere Mortals with Nick Chase
Adventures in Machine Learning ML 020: How to Make an Impact on the Development Community
Adventures in Machine Learning Mentorship and Management: Creating a Collaborative Work Environment - ML 157
Adventures in Machine Learning Evaluating and Building AI Systems - ML 166
Adventures in Machine Learning Data Pipelines with Metaflow featuring Ville Tuulos - ML 036
Adventures in Machine Learning Data Paradoxes in Data Sets with Pier Paolo Ippolito - ML 052
Adventures in Machine Learning Building AI Data Responsibly with Edouard d’Archimbaud - ML 081
Adventures in Machine Learning Apache Spark Integration and Platform Execution for ML - ML 073
Adventures in Machine Learning Multi-modal AI and Machine Teaching ft. Slater Victoroff - ML 045
Adventures in Machine Learning Moving from Dev Notebooks to Production Code - ML 098
Adventures in Machine Learning From Software Engineer to Data Engineer ft. Alexey Grigorev - ML 042
Adventures in Machine Learning Optimizers in Machine Learning, Featuring Maciej Balawejder - ML 077
Adventures in Machine Learning Innovative Security Solutions for Developers - ML 174
Adventures in Machine Learning Machine Learning for Tabular Data in Practice ft. Mark Ryan - ML 040
Adventures in Machine Learning BONUS: How Charles Max Wood Started Podcasting -- And You Can Too
Adventures in Machine Learning Navigating Authority and Transparency in Organizations - ML 142
Adventures in Machine Learning Evolution of Dlib: Addressing Challenges in Machine Learning and Computer Vision - ML 141
Adventures in Machine Learning The Influence of Gen AI on Personalized Education and Curiosity - ML 171
Adventures in Machine Learning Prediction Intervals - ML 056
Adventures in Machine Learning Strategies for Improving Code Quality and Maintenance in the Python Environment - ML 140
Adventures in Machine Learning Lyft's ML Infrastructure Journey - ML 139
Adventures in Machine Learning From Open Source to Traditional ML with James Lamb - ML 138
Adventures in Machine Learning Beyond Machine Learning - ML 136
Adventures in Machine Learning Unraveling AI's Impact: Computer Vision, Generative Models, and Challenges in Software Development - ML 135
Adventures in Machine Learning Complexity Theory - ML 134
Adventures in Machine Learning Causal Analysis - ML 132
Adventures in Machine Learning Data Visualization and Hugging Face - ML 131
Adventures in Machine Learning Confidence as Data Scientist - ML 130
Adventures in Machine Learning How to Integrate ML and Data Science Systems to Web and Mobile Apps - ML 055
Adventures in Machine Learning A Case Study: Recommendation Engines - ML 129
Adventures in Machine Learning ML 027: Staying Current in Machine Learning
Adventures in Machine Learning Maximizing Efficiency in ML Project Development - ML 128
Adventures in Machine Learning Using AI to Make the LifeCycle of Software Development Easier ft. Antonio Alegria - ML 046
Adventures in Machine Learning AI that Make You Better - ML 127
Adventures in Machine Learning ML 018: Mastering Data Pipelines with Apache Spark with Jean-Georges Perrin
Adventures in Machine Learning Machine Learning on Mobile Devices and More with Aliaksei Mikhailiuk - ML 084
Adventures in Machine Learning ML 009: Effective Machine Learning in Academia and Industry with Hassan Kane
Adventures in Machine Learning Challenges for LLM Implementation - ML 126
Adventures in Machine Learning ML in the Cannabis Industry - ML 125
Adventures in Machine Learning How AI Impacts Society - ML 124
Adventures in Machine Learning LLMs on Azure - ML 123
Adventures in Machine Learning How to Create Team Utils - ML 122
Adventures in Machine Learning How to Get Sh*t Done - ML 121
Adventures in Machine Learning ML at Netflix and How to Learn Deeply - ML 120
Adventures in Machine Learning How to get Promoted - ML 119
Adventures in Machine Learning How to Learn a New Tool - ML 117
Adventures in Machine Learning The Innovation Cycle of AI - ML 116
Adventures in Machine Learning How to Transition from Academics to Industry - ML 114
Adventures in Machine Learning Optical Character Recognition (OCR) and Machine Learning with Ahmad Anis - ML 086
Adventures in Machine Learning How to Make your Projects Succeed - ML 113
Adventures in Machine Learning ML 019: Artificial Intelligence as a Service with Peter Elger and Eóin Shanaghy
Adventures in Machine Learning Functional Programming Shift and Scalable Architecture Insights - ML 158
Adventures in Machine Learning Building, Testing, and Abandoning Software - ML 163
Adventures in Machine Learning ML 001: The Adventures in Machine Learning First Steps
Adventures in Machine Learning BONUS: Measuring Apps and Entrepreneurship with John-Daniel Trask
Adventures in Machine Learning How to Think Like a Principal Architect - ML 112
Adventures in Machine Learning Two Case Studies: Production ML infrastructure and Recommendation Engines - ML 072
Adventures in Machine Learning How to Transition from Software Engineer to ML Engineer - ML 111
Adventures in Machine Learning Machine Learning for Meeting Notes - ML 110
Adventures in Machine Learning Transformers and Attention in Machine Learning ft. Ekrem Aksoy - ML 039
Adventures in Machine Learning Model Serving at Databricks - ML 109
Adventures in Machine Learning How Does ChatGPT Work? - ML 107
Adventures in Machine Learning ChatGPT and the Divine - ML 105
Adventures in Machine Learning Deep Learning for Tabular and Time Series Data - ML 104
Adventures in Machine Learning From Golf Instructor to Software Developer: Taking Next Steps in your Career - ML 080
Adventures in Machine Learning Notebooks vs. IDEs With Fabian Jakobs - ML 103
Adventures in Machine Learning How To Think About Optimization - ML 102
Adventures in Machine Learning BONUS: How Jason Weimann Became a Game Developer
Adventures in Machine Learning Protecting Your ML From Phishing And Hackers - ML 101
Adventures in Machine Learning The Disruptive Power of Artificial Intelligence - ML 100
Adventures in Machine Learning A History Of ML And How Low Code Tooling Accelerates Solution Development - ML 099
Adventures in Machine Learning Innovation and AI Strategies with Award Winning Data Science Leader Vidhi Chugh - ML 085
Adventures in Machine Learning How to Build and Organize Production ML Solutions ft. Conor Murphy - ML 047
Adventures in Machine Learning How to Edit and Contribute to Existing Code Base - ML 097
Adventures in Machine Learning Apache Spark (Pt. 2): MLlib - ML 074
Adventures in Machine Learning Don't Let These Things Keep You From Podcasting - BONUS
Adventures in Machine Learning Becoming the Go-To Person in Your Technology Area - BONUS
Adventures in Machine Learning AI Assisted Development ft. Sydney Lai - ML 044
Adventures in Machine Learning How To Do Post-Production with Abhilash Pattnaik - ML 062
Adventures in Machine Learning BONUS: How Opportunities Come Your Way When You're an Influencer
Adventures in Machine Learning ML 017: The Nature of the World and AI with Rishal Hurbans
Adventures in Machine Learning ML 007: Computer Vision & AI Scientist with Beril Sirmacek
Adventures in Machine Learning Redefining Data Science Roles: Beyond Technical Skills and Traditional Job Descriptions - ML 155
Adventures in Machine Learning For Sports and Beyond: Robotics and Advanced Cognitive Computing-Based Video Processing Algorithms - ML 069
Adventures in Machine Learning BONUS: What is Charles Max Wood's Biggest Payoff for Being a Dev Influencer?
Adventures in Machine Learning Adaptive Industry ML: Challenges, Automation, and Model Applications - ML 149
Adventures in Machine Learning Balancing Theoretical Knowledge with Hands-on Experience - ML 154
Adventures in Machine Learning The Impact of AI Tools on Software Development and Quality Assurance - ML 150
Adventures in Machine Learning Parallelizing Model Training with Michael Galarnyk - ML 032
Adventures in Machine Learning How to Beef Up Your Resume - ML 068
Adventures in Machine Learning Demystifying AI Innovations - ML 165
Adventures in Machine Learning Leveling Up in your Data Science Career with Adam Ross Nelson - ML 083
Adventures in Machine Learning How to Get Hired at a FANG Company - BONUS
Adventures in Machine Learning MLOps 101: Scoping, Latency, Data Curation, and Continuous Model Retraining - ML 143