Watch On Demand

The MLOps Live Webinar Series

Session #17

Watch On Demand

On-Demand

Session #17: Scaling NLP Pipelines at IHS Markit

The data science team at IHS Markit shared practical advice on building sophisticated NLP pipelines that work at scale. Using a robust and automated MLOps process, they run complex models that make massive amounts of unstructured data searchable and indexable.

In this session, they shared their journey with MLOps and provide practical advice for other data science teams looking to:

  • Ingest, prepare, classify and index structured and unstructured data (in this case, PDFs and Images)
  • Handle terabytes of data in hours, not months
  • Make deployment of models seamless by working in one unified research and production environment
  • Leverage CI/CD for ML
  • Allow for sharing and reuse of components across projects and teams
  • Utilize auto-scaling serverless functions to abstract away infrastructure complexities
  • Build rapidly, iterate faster and focus on the business logic and not the underlying infrastructure

 

Nick and Yaron  discussed their approach to automating the NLP pipeline end to end. They’ll also explained how to use Iguazio and the MLRun open source framework, which comes with capabilities such as Spot integration and Serving Graphs, to reduce costs, accelerate and simplify the data science process.

Presented By
Yaron Haviv

Co-Founder and CTO, Iguazio

Nick Brown

Senior Data Scientist, IHS Markit