1844 IT & Software Developer jobs in the US
Software Engineer - Java or Python
$100,600 - 199,000
Microsoft Corporation
Northeast 36th Way, Redmond
$100,600 - 199,000
Requirements
Must:
- Bachelors degree in Computer Science or a related technical field AND 2+ years of technical engineering experience in programming languages such as C, C++, C#, Java, or Golang, OR equivalent experience.
- Strong understanding of software engineering principles, distributed computing, and system architecture.
- Proven experience working on high-scale, reliable online systems.
- Familiarity with real-time online services that require low latency and high throughput.
- Knowledge of Layer 7 (L7) network proxies and gateways.
- Understanding of network architecture and protocols, including HTTP and TCP, as well as authentication and session management.
- Experience with OSS technologies, Docker, Kubernetes, C++, Golang, or similar programming languages.
- Strong collaboration skills and ability to work closely with teams of researchers and developers.
- Capability to independently lead projects.
- Must meet Microsoft, customer, and/or government security screening requirements for this role.
Responsibilities
- Design and develop core inference infrastructure for deploying cutting-edge AI models in a production environment.
- Identify and implement enhancements to improve end-to-end inference performance and efficiency of advanced LLMs and GenAI models from OpenAI, Anthropic, and xAI hosted on AI Foundry.
- Create and execute effective load scheduling and balancing strategies by utilizing key insights related to the models and workloads.
- Scale the platform to accommodate increasing inference demand while ensuring high availability.
- Provide essential capabilities to support the latest Gen AI models such as GPT5, Realtime audio, Sora, and facilitate rapid market introduction for them.
- Lead initiatives to develop features aimed at meeting customer needs, including those from GitHub, M365, Microsoft AI, and third-party companies.
- Collaborate effectively with both internal and external partners.
- Represent and embody Microsofts cultural values and principles.
Description
We are a pioneering team within the Microsoft Azure AI Inference platform, dedicated to transforming the AI landscape. Positioned at the forefront of the AI revolution, we empower our partners and customers to responsibly unlock the potential of AI. We provide a fully managed AI Inference platform designed to enhance the research, development, and operationalization of AI-driven intelligent solutions at scale. Our team manages the hosting, optimization, and scaling of the inference stack for Azure AI Foundry models, including leading advancements from OpenAI and other notable sources. Joining us means participating in a collaborative environment that values diverse perspectives and continuous innovation in service of our mission to empower individuals and organizations worldwide.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Machine Learning Engineer salaries in the United States here.
How many Machine Learning Engineer jobs are in the United States?
Currently, there are 1844 ML, AI openings. Check also: TensorFlow jobs, Python jobs, Computer-Vision jobs - all with salary brackets.
Is the US a good place for Machine Learning Engineers?
The US is one of the best countries to work as a Machine Learning Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Machine Learning Engineer jobs in the United States?
Snaplii, KUBRA, Nurse Next Door, Cobmex® Apparel Inc., D3 Security Management Systems, Sequoia Software, Ashmead Designs Ltd. among others, are currently hiring for ML, AI roles in the United States.
The company with most openings is Jobot as they are hiring for 124 different Machine Learning Engineer jobs in the United States. They are probably quite committed to find good Machine Learning Engineers.
The company with most openings is Jobot as they are hiring for 124 different Machine Learning Engineer jobs in the United States. They are probably quite committed to find good Machine Learning Engineers.