Shivay Lamba

Camp Counselor

Building Machine Learning based Microservices using OSS

Event Logo

Tuesday, July 30, 2024 - 6:00 PM UTC, for 1 hour.

Regular, 60 minute presentation

Room: African 10

The difficulty of transitioning from research to production is a prevalent issue in the machine learning development life cycle. An ML team may need to modularize and rework their code to work more effectively in production. Occasionally, depending on whether the application requires offline, online, or streaming predictions, this can necessitate re-implementing and maintaining feature engineering or model prediction logic in several locations. The audience will learn about different open-source microframeworks for creating machine learning applications in this session. One such example UnionML, developed by the Flyte team, offers a straightforward, user-friendly interface for specifying the fundamental components of your machine learning application, from dataset curation and sampling to model training and prediction. UnionML automatically generates the procedures required to fine-tune your models and release them to production in various prediction use cases, such as offline, online, or streaming settings using these building blocks. There will be a live demonstration by taking an end-to-end machine learning-based example written in Python. We can look to the web for ideas while we consider a solution to this issue. For instance, the HTTP protocol, which provides a backbone of techniques with clearly defined but flexible interfaces, standardizes the way we move data across the internet. We were interested in posing the question, "What if we could develop, automate, and monitor data and ML pipelines at scale?" as machine learning systems proliferate across industries. https://github.com/unionai-oss/unionml

Prerequisites

basics of Machine learning

Take Aways

  • Learn how to integrate machine learning in regular software development
  • learn how to efficiently deploy machine learning - MLOps
favorited by:
Dave Boulineau Dan Willman Rebecca Von Ruden Josh Gretz Josh Rice Carlos "El Guapo" Porras Rodriguez Matthew Ertl Yuhe Yuan Andy Bottom Jesse Dahir-Kanehl Steve Riebe Nick Heidke Brian Robertson Jimmy Zhao Lizzie Siegle Ryan Holmes Timothy Lynch Jr Erica Stanley Ellie Zubrowski Spenser Austin Dave Smith Barry Stahl Kyle Schroeder Steven Hicks Jason Cairol Kris Erdahl Jonathan Renier-Wigg Samantha Dahlby Shaq Mughal Edward Lichtman Brett Christiansen Joel Keyser Jason Von Ruden Cameron Vetter Dustin Ewers Brett Allenstein Justin Weyenberg