2956 IT & Software Developer jobs in the US
Staff Software Engineer, AI
$200,000 - 275,000
Cayuse Holdings, LLC
Burlingame Avenue 1315, Burlingame
$200,000 - 275,000
Requirements
Must:
- Over 5 years of experience in backend or full-stack software engineering, including at least 3 years working on ML/LLM-attached applications.
- Proficiency in coding, particularly in Python, along with familiarity in a statically typed language such as Go, Java, or TypeScript.
- Experience with frameworks for LLM integration such as Hugging Face, LangChain, LlamaIndex, OpenAI APIs, or Anthropic.
- Strong understanding of distributed systems and service-oriented architectures, particularly in API development at scale.
- Expertise in cloud technologies like AWS, Google Cloud Platform, Azure, along with Kubernetes, Docker, and Terraform.
- Knowledge in MLOps/LLMOps processes such as CI/CD for models, monitoring, and ensuring reproducibility.
- Exceptional system design capabilities and the ability to connect technical architecture with product objectives.
- Preferred qualifications include operational experience with LLMs in healthcare or heavily regulated sectors (e.g., FHIR, HL7, HIPAA).
- Experience with RAG pipelines, vector databases, and structured-output orchestration would be beneficial.
- A background in enterprise SaaS or crucial platforms where uptime, latency, and scalability are essential.
- Familiarity with responsible AI, safety, and privacy-preserving machine learning approaches.
Responsibilities
- Design and build scalable, low-latency APIs and services for LLM orchestration and optimization specific to healthcare applications.
- Create ingestion, preprocessing, and retrieval-augmented generation pipelines that integrate LLMs with clinical and revenue-cycle datasets.
- Develop systems for monitoring, evaluating, and tracking costs of models while implementing safeguards to ensure responsible use.
- Engineer solutions focused on caching, batching, load balancing, and scaling LLM tasks in cloud and container settings.
- Ensure the implementation of HIPAA-compliant infrastructure, including data governance and audit capabilities for LLM-driven applications.
- Collaborate with product teams, ML engineers, and healthcare specialists to seamlessly convert business workflows into effective backend solutions.
- Lead the successful delivery of LLM backend projects, establish best engineering practices, and provide mentorship in LLM system design.
Description
We are on the lookout for a Staff Software Engineer in Applied AI to develop and enhance the backend systems that drive large language model applications within the healthcare sector. This exciting position is perfect for an engineer who excels at combining backend architecture with applied AI, focusing on API design, pipelines, and infrastructure that ensure LLMs operate reliably, securely, and cost-effectively in real-world situations. Our competitive salary ranges from $200,000 to $275,000 per year, and the role is based in Burlingame, CA, with hybrid working arrangements. If you are eager to transition LLMs from theoretical exercises to vital healthcare workflows, we welcome your application!
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Machine Learning Engineer salaries in the United States here.
How many Machine Learning Engineer jobs are in the United States?
Currently, there are 2956 ML, AI openings. Check also: TensorFlow jobs, Python jobs, Computer-Vision jobs - all with salary brackets.
Is the US a good place for Machine Learning Engineers?
The US is one of the best countries to work as a Machine Learning Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Machine Learning Engineer jobs in the United States?
VenHub, AMERICAN SYSTEMS, Trimlite, Menusifu, Inc., Concordia Group, Peraton, Active Datacomm among others, are currently hiring for ML, AI roles in the United States.
The company with most openings is Lockheed Martin Corporation as they are hiring for 273 different Machine Learning Engineer jobs in the United States. They are probably quite committed to find good Machine Learning Engineers.
The company with most openings is Lockheed Martin Corporation as they are hiring for 273 different Machine Learning Engineer jobs in the United States. They are probably quite committed to find good Machine Learning Engineers.