Senior AI Engineer · Bengaluru, India

Engineering intelligence — from raw data to production AI, at enterprise scale.

6+ years across AI, Machine Learning and Data Science — turning messy enterprise data into models, pipelines and systems that a business can actually run on. Currently leading applied AI at Baker Hughes.

6+Years in AI/ML
1000sUsers Served in Production
2Publications
AWSCloud & MLOps
The Journey

Curiosity first. Code came after.

Rohit Mali at India Energy Week 2025
Rohit Mali — India Energy Week, 2025

Rohit has always been drawn to the moment something starts to understand — a system that goes from following instructions to actually reasoning about a problem. That curiosity pulled him from electrical engineering into software, and eventually into a front-row seat for the biggest shift the field has seen: language models that read, retrieve and act. What keeps him hooked isn't the novelty of AI — it's the craft of making it reliable at enterprise scale: watching a system he built help a colleague find an answer buried in thousands of technical documents in seconds, or a translation tool bridge a language gap for hundreds of engineers on a rig floor. That same instinct for communication and storytelling shows up outside work too, on stage in inter-college drama competitions — a reminder that the best engineering, like the best story, is really about making something complex easy for someone else to understand.

How Rohit Approaches AI Work
01

Understand the Problem

Translate an ambiguous business ask into a concrete, solvable AI problem before writing a line of code.

02

Architect the System

Decide how data, models, retrieval and infrastructure fit together end-to-end, with ownership of the full design.

03

Build & Evaluate

Engineer with LLMs, RAG and agentic workflows — then benchmark rigorously before anything reaches production.

04

Ship & Operate

Deploy on cloud infrastructure with CI/CD and monitoring, so the system stays reliable long after launch.

Career Path

Experience

Four roles across two companies, each one a step deeper into production AI.

Senior AI Engineer
Aug 2025 — Present
Baker Hughes · Bengaluru, India
  • Own end-to-end LLM hosting and serving infrastructure — compiling and optimizing open-source models for production inference with significantly faster throughput and full data sovereignty.
  • Architected a hierarchical agentic automation platform for turbine and heavy machinery procurement, orchestrating multi-agent, tool-augmented workflows that cut manual procurement cycles.
  • Engineered a production RAG document Q&A system across thousands of PDFs, integrating self-hosted LLMs, reranker models and vector databases for enterprise-scale natural language querying.
  • Built a standardized Judge-LLM evaluation pipeline benchmarking LLMs and RAG systems on retrieval quality, accuracy, hallucination rate and latency.
LangGraphAgentic RAGVector DBMLOpsAWS
AI Engineer
Apr 2023 — Aug 2025
Baker Hughes · Bengaluru, India
  • Led development of an in-house translation application serving 400+ active users, fine-tuning the Zephyr model on Oil & Gas domain terminology.
  • Built an end-to-end RAG document chat application using Llama and a reranker model over a vector database.
  • Defined Judge-LLM benchmarking logic to systematically compare candidate LLMs before production rollout.
  • Managed deployment of NLP applications on AWS via Jenkins CI/CD pipelines.
RAGLlamaHugging FaceJenkins
Software Engineer
Oct 2021 — Apr 2023
Baker Hughes · Bengaluru, India
  • Built and maintained data infrastructure and ETL pipelines using AWS services and Python.
  • Designed data transformations with Talend and built Tableau visualizations to support data-driven decisions.
  • Collaborated across teams to ensure reliable data management and delivery.
AWSTalendTableauETL
Software Engineer
Jan 2020 — Oct 2021
Equifax · Mumbai, India
  • Built microservices with Spring Boot and RESTful APIs using Python and FastAPI.
  • Designed ETL pipelines with Spark SQL, Oozie and Sqoop across structured and unstructured sources.
  • Migrated data to GCP via Database Migration API; managed Cassandra and Oracle databases.
  • Automated workflows with Linux shell scripting; owned project delivery end-to-end.
Spring BootSpark SQLGCPCassandra
Toolkit

Technical Skills

AI / ML

Generative AILLMsRAG SystemsAgentic AIAgentic RAGLLM Fine-TuningNLPJudge-LLM EvaluationMCPTransformers

Frameworks & Libraries

LangChainLlamaIndexLangGraphLangSmithHugging FacevLLMTensorRT-LLM

Cloud & MLOps

AWS (ECS, Bedrock, Lambda, ECR, S3)DockerJenkinsGitHub ActionsCI/CDPrometheusGrafanaMLflowDVC

Programming & Data

PythonSQLShell ScriptingC++Vector DatabasesCassandraOraclePostgreSQLSpark SQL
Research & Recognition

Publications & Honors

ADIPEC · Published

Enhancing Enterprise-Wide Information Retrieval through RAG Systems

Techniques, evaluation strategies and scalable deployment methodologies for enterprise-grade RAG applications.

GASTECH · Submitted

Leveraging LLMs for Fine-Tuning MT Models in the Oil & Gas Domain

Fine-tuning OPUS machine translation models with LLMs to improve accuracy of domain-specific technical terminology.

Winner — Equifax Hackathon 2021
Winner — Inter-College Drama Competition
3rd Place — Inter-College Troubleshooting Competition
Foundations

Education & Certifications

Bachelor of Engineering — Electrical & Electronics Engineering
Bhartiya Vidya Bhavan's Sardar Patel Institute of Technology, Mumbai
2016 — 2020
HSC, Science
Mithibai College of Arts, Chauhan Institute of Science & A.J. College of Commerce and Economics, Mumbai
2014 — 2016
  • AWS Certified Solutions Architect
  • MLOps for Scalable Architecture
  • Machine Learning Fundamentals
  • C++ Data Structures
  • Embedded C — Level 0
  • Core Java