AI Exchange
timezone
+00:00 GMT
SIGN IN
  • Home
  • Events
  • Content
  • People
  • Messages
  • Channels
  • Help
Sign In
Sign in or Join the community to continue

Towards Observability for Machine Learning Pipelines with Shreya Shankar

Posted Jul 14
# ML
Share
SPEAKER
Shreya Shankar
Shreya Shankar
Shreya Shankar
PhD Student at the RISELab @ UC Berkeley

Shreya Shankar is doing her PhD in data management for machine learning (ML) systems at UC Berkeley. She works on streaming systems and open-source tooling for ML monitoring. Previously, she was the first ML engineer at a startup, did deep learning research at Google Brain, and completed her BS and MS in computer science at Stanford.

+ Read More

Shreya Shankar is doing her PhD in data management for machine learning (ML) systems at UC Berkeley. She works on streaming systems and open-source tooling for ML monitoring. Previously, she was the first ML engineer at a startup, did deep learning research at Google Brain, and completed her BS and MS in computer science at Stanford.

+ Read More
SUMMARY

Software organizations are increasingly incorporating machine learning (ML) into their product offerings, driving a need for new data management tools. Many of these tools facilitate the initial development of ML applications, but sustaining these applications post-deployment is difficult due to lack of real-time feedback (i.e., labels) for predictions and silent failures that could occur at any stage, or component, of the ML pipeline (e.g., data distribution shift). We propose a new type of data management system that offers end-to-end observability, or visibility into complex system behavior, for ML pipelines through assisted (1) detection, (2) diagnosis, and (3) reaction to ML-related bugs. We describe new research challenges and suggest preliminary solution ideas in all three aspects. Finally, we introduce an example architecture for a “bolt-on” ML observability system, or one that wraps around existing tools in the stack.

+ Read More

Watch More

31:05
Posted Oct 06 | Views 8.2K
# TransformX 2021
# Keynote
27:25
Posted Oct 06 | Views 751
# TransformX 2021
# Breakout Session
47:38
Posted Oct 06 | Views 1.1K
# TransformX 2021
# Expert Panel
See more