Machine Learning - Model Serving Job at Alexander Chapman, Santa Clara, CA

MUV3MC9rbDRqNVRtNWoxNDlRb1ZodWNHOVE9PQ==
  • Alexander Chapman
  • Santa Clara, CA

Job Description

We are working with a company building intuitive, voice-first AI systems that blend natural interaction with powerful model performance. Founded by leaders from Meta, Oculus, and Google, they’re creating a new class of consumer devices powered by speech, vision, and LLMs.

The Role

You’ll help optimize and scale the inference stack, working across model serving, performance tuning, and deployment to support real-time, multimodal AI.

What You’ll Do

  • Improve serving systems for LLMs, speech, and vision models.
  • Optimize throughput, latency, and cost using advanced techniques like batching, caching, and kernel tuning.
  • Extend frameworks like VLLM or SGLang to push the limits of performance.
  • Collaborate with training teams to deploy faster, lighter models.
  • Experiment with compilers and hardware backends to boost efficiency.

What We’re Looking For

  • Strong experience with PyTorch or similar ML frameworks.
  • Deep knowledge of model serving and systems performance.
  • Skilled in low-level debugging, bottleneck analysis, and server optimization.
  • Familiar with VLLM, Ray, or deploying inference workloads at scale.
  • Comfortable owning complex infrastructure projects end to end.
  • Background in computer science or related field from a top-tier university (e.g. Stanford, MIT, Ivy League).
  • Experience at a top tech company (e.g. FAANG) or a successful, high-growth startup.

They’re looking for curious, impact-driven engineers ready to push what’s possible with real-time AI.

Job Tags

Similar Jobs

St. Mary's Regional Medical Center

Nurse Tech Nursing Student Job at St. Mary's Regional Medical Center

 ...s Regional Medical Center. We are seeking a highly skilled Nursing Student to join our team at St. Mary's Regional Medical Center!...  ...Position Summary: ~ After evaluation of competency, the Nurse Tech is allowed to perform all duties of a nursing assistant as well... 

Agama solutions Corp

Salesforce Administrator Job at Agama solutions Corp

 ...Direct message the job poster from Agama solutions CorpSalesforce Administrator (Local to: Hartford, CT)SKILLS salesforce platform...  ...update system documentation accordinglySeniority level Seniority level Entry levelEmployment type Employment type ContractJob function... 

Sanofi

Director HCP Marketing, Gastroenterology Job at Sanofi

 ...for Dupixent. The Director, HCP Marketing, Gastroenterology will lead execution of the US strategic business direction for EoE HCP Promotion. Demonstrated strategic agility and strong professional marketing experience is required. Responsibilities include strategic... 

Dairy Farmers of America

Route Delivery Driver - Class A CDL Job at Dairy Farmers of America

Reiter Dairy is recruiting for qualified candidates for a CDL A Route Delivery Driver position to operate a tractor-trailer safely and efficiently and manually unload/deliver various Dairy products, to customer locations on an assigned route schedule. Our drivers build... 

MyJobResource

Library Assistants Job at MyJobResource

We are excited to announce that we are seeking dedicated individuals for Part-Time and Full-Time Library Assistant positions. This is a fantastic opportunity for anyone looking to start a rewarding career in the library sector, with no prior experience required. Comprehensive...