Senior ML Infrastructure Engineer - Leading AI/ML Platform Company

Bay Area, CA (Hybrid)

Company Description

Our client is a well-funded, rapidly growing AI infrastructure company revolutionizing how enterprises develop and deploy Large Language Models (LLMs). With $25M in funding and a mission to democratize AI capabilities, they're building cutting-edge technology that enables companies to harness the power of LLMs within their existing infrastructure.

What You'll Do

• Architect and implement advanced LLM platforms on Kubernetes, enabling enterprise-scale model tuning and inference
• Solve complex distributed systems challenges across diverse customer environments
• Drive innovation in LLM infrastructure, staying ahead of emerging technologies and industry trends
• Collaborate with ML engineers, application developers, and product teams to deliver robust platform features
• Design scalable solutions that address enterprise customers' diverse requirements
• Help shape the future of AI infrastructure in a fast-paced startup environment

Ideal Candidate Background

• 5+ years of professional software engineering experience
• 3+ years of hands-on experience with AI/ML infrastructure and platforms
• Strong background in distributed systems and Kubernetes
• Experience building and maintaining LLM platforms or similar ML infrastructure
• Proven track record debugging complex distributed systems
• Bachelor's degree in Computer Science or related field
• Proficiency in Go/Python or similar languages

Preferred Qualifications

• Experience with LLM training pipelines (pre-training, post-training, fine-tuning)
• Background in self-driving car infrastructure or other complex distributed systems
• Track record of working in ambiguous, fast-paced environments
• Open-source contributions to ML/infrastructure projects

Compensation & Benefits

• Competitive base salary: $200K - $250K
• Generous equity package: 0.3% - 0.5%
• Comprehensive benefits package
• Visa sponsorship available (TN, H1B, H1B Transfer, visa renewals)
• Hybrid work environment in the heart of Silicon Valley
• Opportunity to work with cutting-edge AI technology
• Ground-floor opportunity at a well-funded startup
• Collaborative team environment with industry experts