1830 IT & Software Developer jobs in the US
Senior Software Engineer - CoreAI Inference
$119,800 - 274,800
Microsoft Corporation
Northeast 36th Way, Redmond
$119,800 - 274,800
Requirements
Must:
- Bachelors Degree in Computer Science or a related technical discipline with a minimum of 4 years of software engineering experience in programming languages such as C, C++, C#, or Java
- OR equivalent practical experience
- Capability to fulfill Microsoft, customer, and/or governmental security screening criteria, including the Microsoft Cloud Background Check, which must be passed upon hire and every two years thereafter
- Over 4 years of design and analytical experience, with knowledge of system performance, scalability, and engineering best practices
- Familiarity with distributed systems, particularly in request processing at scale, including inferencing, L7 gateways, high-performance storage, and global-scale distributed databases
- Proven track record of creating high-quality, reliable systems at scale
- Proficiency in modern AI-enhanced development tools and workflows for increased efficiency, quality improvement, and enhanced engineering impact
- A customer-centric approach to problem-solving, demonstrating empathy and a commitment to delivering meaningful solutions
Responsibilities
- Act as a hands-on technical leader in designing, implementing, and deploying core serving systems, intelligent routing, and request management for a diverse array of LLMs, including OpenAI, Mistral, and Grok
- Develop expansive AI services and platform capabilities that drive new product features and customer experiences
- Propel innovative advancements in AI systems while collaborating with top-notch engineers and cross-functional teams
- Provide leadership through system architecture, code evaluations, mentorship, and uphold technical standards while remaining directly involved in implementation
- Enhance the reliability, scalability, visibility, efficiency, and performance of critical services
Description
We are excited to invite you to join our team at CoreAI, where we are at the forefront of developing the AI data-plane that facilitates LLM inferencing across Microsoft and Azure customers, ranging from innovative startups to Fortune 500 corporations. Our integrated AI framework ensures consistent and ultra-low latency inference capabilities for all LLMs included in the Microsoft catalog, like OpenAI, Anthropic, Mistral, and Cohere. As a Senior Software Engineer, you will play a pivotal role in shaping the future of one of the most rapidly advancing services in Azure, vital to Microsofts AI strategy. Our goal is to provide scalable, reliable solutions that enrich AI-driven product experiences. This is a dynamic environment filled with opportunities for growth, innovation, and a chance to influence the industry significantly.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Machine Learning Engineer salaries in the United States here.
How many Machine Learning Engineer jobs are in the United States?
Currently, there are 1830 ML, AI openings. Check also: TensorFlow jobs, Python jobs, Computer-Vision jobs - all with salary brackets.
Is the US a good place for Machine Learning Engineers?
The US is one of the best countries to work as a Machine Learning Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Machine Learning Engineer jobs in the United States?
Ryan Design International, Steinbach Credit Union, KUBRA, D3 Security Management Systems, Nurse Next Door, Gatestone & Co. Inc, Snaplii among others, are currently hiring for ML, AI roles in the United States.
The company with most openings is Jobot as they are hiring for 124 different Machine Learning Engineer jobs in the United States. They are probably quite committed to find good Machine Learning Engineers.
The company with most openings is Jobot as they are hiring for 124 different Machine Learning Engineer jobs in the United States. They are probably quite committed to find good Machine Learning Engineers.