Location: San Francisco, California
Job ID: P-984

Build the Infrastructure Powering the Next Generation of Generative AI

Are you passionate about building large-scale machine learning platforms that enable the development, training, evaluation, and deployment of cutting-edge Generative AI applications?

Databricks Mosaic AI is seeking a Senior Machine Learning Engineer – GenAI Platform to help shape the future of enterprise AI development. This role offers the opportunity to work across the entire machine learning lifecycle while building the foundational infrastructure that powers next-generation Generative AI products.

From distributed systems and GPU orchestration to user-facing platform experiences, you’ll play a critical role in developing technology that enables organizations to securely build and deploy custom AI models at scale.

About Mosaic AI

Founded in late 2020 by a team of machine learning engineers and researchers, Mosaic AI was created with a vision to make advanced AI development more accessible, secure, and customizable for enterprises.

The Mosaic AI platform enables organizations to:

• Fine-tune custom AI models
• Train large-scale machine learning systems
• Deploy Generative AI applications securely
• Maintain complete ownership and control of their data and models
• Operate across all major cloud providers

In 2023, Mosaic AI introduced pretrained transformer models that established a new benchmark for commercially usable open-source Large Language Models (LLMs), achieving more than 3 million downloads worldwide.

Since joining Databricks in July 2023, Mosaic AI has continued its mission of helping organizations unlock the full value of artificial intelligence while maintaining security, flexibility, and scalability.

The Opportunity

The Generative AI landscape is evolving rapidly, and Databricks Mosaic AI is building the platform that powers every stage of the ML development lifecycle.

As a Senior Machine Learning Engineer, you’ll help develop customer-facing capabilities supporting:

• Data Generation
• Model Training
• Model Evaluation
• Model Serving
• AI Agent Development

This role is ideal for engineers who enjoy combining product thinking with deep technical expertise and who thrive when building systems that directly impact customers.

What You’ll Be Building

You will contribute to a platform that powers Generative AI use cases across the complete machine learning workflow.

Your work may span:

Customer-Facing Product Experiences

Designing interfaces and platform capabilities that simplify AI development for customers.

Distributed Backend Systems

Building scalable infrastructure capable of supporting large-scale AI workloads.

GPU-Oriented Infrastructure

Developing low-level systems that efficiently orchestrate compute resources for model training and serving.

End-to-End ML Lifecycle Platforms

Creating reliable systems that support data preparation, training, evaluation, deployment, and monitoring.

Key Responsibilities

Drive End-to-End Product Development

• Play a key role in the end-to-end design and implementation of the Generative AI platform.
• Build solutions that support training and serving use cases for Generative AI models.
• Contribute to both frontend product experiences and backend infrastructure.

Collaborate with Customers & Researchers

• Work closely with customers to understand real-world AI challenges.
• Partner with internal machine learning researchers to identify platform improvements and future opportunities.
• Translate customer feedback into scalable product capabilities.

Own the Full Product Lifecycle

• Demonstrate strong end-to-end ownership across design, development, deployment, and maintenance.
• Convert product requirements into intuitive user experiences and scalable distributed systems.
• Lead implementation efforts from concept to production.

Build Core Platform Infrastructure

• Design and develop foundational systems supporting customer-facing AI products.
• Ensure infrastructure remains scalable as customer workloads continue to grow.
• Contribute to platform reliability, performance, and operational efficiency.

Ensure Enterprise-Grade Reliability

• Maintain the security, reliability, and scalability of backend systems.
• Build resilient distributed architectures capable of supporting mission-critical AI workloads.
• Continuously improve operational excellence across the platform.

Required Qualifications

Software Engineering Experience

• 4+ years of hands-on programming experience.
• Proficiency in at least one modern programming language, including:
  • Python
  • Scala
  • Go
  • C++

Distributed Systems Expertise

• Strong understanding of distributed systems design principles.
• Experience building and operating large-scale distributed applications.
• Ability to design highly scalable backend infrastructure.

Machine Learning Platform Development

Experience building ML platform systems supporting:

• Data Preparation
• Model Training
• Model Evaluation
• Model Serving

across the machine learning model development lifecycle.

Additional Preferred Experience

• Direct experience developing machine learning models is considered a plus but is not required.

Product Ownership & System Design

• Strong sense of end-to-end product ownership.
• Ability to balance robust system design with excellent product usability.
• Experience translating customer needs into technical solutions.

Communication & Collaboration

• Excellent communication and stakeholder management skills.
• Ability to explain complex technical concepts to both technical and non-technical audiences.
• Comfortable working with cross-functional internal and external teams.

Growth Mindset

We value engineers who:

• Are curious about every aspect of the company’s success.
• Enjoy learning new technologies.
• Take ownership beyond their immediate responsibilities.
• Continuously seek opportunities to improve systems, products, and customer experiences.

Why Join Databricks Mosaic AI?

Joining Databricks Mosaic AI means helping build one of the industry’s most advanced Generative AI platforms while working alongside world-class researchers, engineers, and AI practitioners.

You’ll have the opportunity to:

• Work on cutting-edge Generative AI technologies.
• Build infrastructure supporting enterprise-scale AI applications.
• Influence product direction and platform strategy.
• Solve challenging distributed systems problems.
• Contribute directly to the future of AI development and deployment.

Compensation & Pay Transparency

Databricks is committed to fair and equitable compensation practices.

Local Pay Range

$166,000 — $225,000 USD

Compensation packages are determined based on several factors, including:

• Job-related skills
• Relevant experience
• Certifications and training
• Geographic location

The total rewards package may also include:

• Annual performance bonuses
• Equity awards
• Comprehensive employee benefits

Databricks anticipates utilizing the full salary range based on candidate qualifications and experience.

About Databricks

Databricks is the Data and AI company trusted by more than 10,000 organizations worldwide.

Industry leaders including Comcast, Condé Nast, Grammarly, and more than 50% of Fortune 500 companies rely on the Databricks Data Intelligence Platform to unify data, analytics, and artificial intelligence.

Founded by the original creators of:

• Apache Spark™
• Delta Lake
• MLflow
• Lakehouse Architecture

Databricks continues to lead innovation across data engineering, analytics, machine learning, and Generative AI.

Headquartered in San Francisco, the company operates globally with offices around the world.

Benefits

Databricks offers comprehensive benefits and employee programs designed to support personal well-being, professional growth, and long-term career success. Benefits may vary by region.

Diversity, Equity & Inclusion

Databricks is committed to creating an inclusive workplace where everyone can excel.

Employment opportunities are offered without regard to age, race, ethnicity, disability, religion, gender identity, sexual orientation, veteran status, socio-economic background, political affiliation, marital status, or any other protected characteristic.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer’s discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

Apply for Senior Machine Learning Engineer – GenAI Platform Jobs at Databricks

If you’re excited about building scalable Generative AI platforms, distributed machine learning systems, AI infrastructure, and next-generation ML development tools, this is your opportunity to join a team shaping the future of enterprise AI.