728 IT & Software Developer jobs in the US
Staff Software Engineer - AI Orchestration
$188,000 - 275,000
CoreWeave
Mathilda Place 100, Sunnyvale
$188,000 - 275,000
Requirements
Must:
- Over 8 years of experience in software engineering, particularly in distributed systems or cloud platforms
- Strong knowledge of Go programming language and experience in creating large-scale, long-term production systems
- In-depth understanding of Kubernetes internals, scheduling strategies, and controller-based architectures
- Proven experience in designing or enhancing orchestration, scheduling, or resource-management platforms
- Ability to lead technical projects across teams without direct authority
- Strong operational mindset with a background in managing mission-critical systems at scale
- Preferred experience with orchestration frameworks such as Kueue, Volcano, Ray, or similar Kubernetes-native tools
- Background in AI infrastructure, ML platforms, HPC, or extensive batch and streaming systems
- Comprehensive understanding of scheduling principles including fairness, pre-emption, quota management, and multi-tenant isolation
- Experience in defining and managing SLOs, capacity models, and significant reliability enhancements
- Contributions to open-source infrastructure or orchestration initiatives
Responsibilities
- Drive the technical vision and architecture for key aspects of the AI Workload Orchestration Platform
- Create scalable and reliable orchestration components for AI workloads across diverse schedulers and environments
- Lead cross-functional architectural reviews and ensure alignment among infrastructure, CKS, and managed inference teams
- Establish platform standards for reliability, observability, capacity management, and operational excellence
- Identify and address systemic performance, scalability, and fairness challenges across large GPU clusters
- Mentor senior engineers and foster technical leadership within the organization
- Represent the platform in technical evaluations and shape the overall CoreWeave platform strategy
Description
At CoreWeave, we are excited to be at the forefront of innovation in AI infrastructure. Our mission is to empower pioneers in the field by providing an essential cloud platform tailored for AI. We prioritize a culture of curiosity, ownership, empowerment, exceptional client experiences, and teamwork. As we navigate a phase of rapid growth, we promote entrepreneurial thinking and collaboration, creating a dynamic environment where innovative solutions can flourish. The role of Staff Software Engineer offers a competitive salary ranging from $188,000 to $275,000, complemented by a robust rewards package that includes a discretionary bonus, equity awards, and comprehensive health benefits—all designed to support our employees diverse needs.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Machine Learning Engineer salaries in the United States here.
How many Machine Learning Engineer jobs are in the United States?
Currently, there are 728 ML, AI openings. Check also: TensorFlow jobs, Python jobs, Computer-Vision jobs - all with salary brackets.
Is the US a good place for Machine Learning Engineers?
The US is one of the best countries to work as a Machine Learning Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Machine Learning Engineer jobs in the United States?
Sched LLC, Jump, DataDis Inc, D3 Security Management Systems, Snaplii, DataAnnotation, SciTec among others, are currently hiring for ML, AI roles in the United States.
The company with most openings is DataAnnotation as they are hiring for 19 different Machine Learning Engineer jobs in the United States. They are probably quite committed to find good Machine Learning Engineers.
The company with most openings is DataAnnotation as they are hiring for 19 different Machine Learning Engineer jobs in the United States. They are probably quite committed to find good Machine Learning Engineers.