895 IT & Software Developer jobs in the US
AI Inference Technology Development Manager
$166,400 - 287,700
Annapurna Labs Inc.
7th Avenue Bike Path, Seattle
$166,400 - 287,700
Requirements
Must:
- A minimum of 3 years of experience in managing engineering teams
- At least 7 years of experience working directly within engineering teams
- A minimum of 3 years of experience in designing or architecting (including design patterns, reliability, and scalability) both new and existing systems
- Proven experience collaborating with product or program management teams
Responsibilities
In this role, I will lead a skilled team of AI engineers to construct essential inference technology building blocks and libraries to help AI developers refine models for inference on Trainium and Inferentia devices. My current focus is on Mixture of Experts (MoE) models like GPT OSS for both Trainium 2 and the forthcoming Trainium 3. I will be responsible for developing and enhancing components like attention kernels and delivering them through the Neuronx_Distributed Inference Libraries, enabling our customers to optimize large language models, multimodal, and generative models. Additionally, I will work closely with senior management and technical leaders to define the latest LLMs' building blocks, managing shifting priorities as new models and technologies arise while ensuring my team can tackle any technical hurdles they face.
Description
At AWS, we are proud to be recognized as the world’s most extensive and widely embraced cloud platform. Our pioneering spirit in cloud computing drives us to innovate continually, earning the trust of diverse clients, from successful startups to Global 500 corporations, with our comprehensive suite of products and services. We value diversity and encourage all candidates to consider applying, even if they don’t meet every single qualification listed. We aim for work-life balance, fostering a flexible culture that supports success at both work and home. Constantly aiming to become Earth’s Best Employer, we emphasize knowledge-sharing and mentorship to foster professional growth. If you have the necessary experience and are passionate about the world of AWS and machine learning technology, we welcome you to apply and become part of our dynamic team.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find IT Manager salaries in the United States here.
How many IT Manager jobs are in the United States?
Currently, there are 895 Manager openings. Check also: CTO jobs, ERP jobs, Architect jobs - all with salary brackets.
Is the US a good place for IT Managers?
The US is one of the best countries to work as a IT Manager. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for IT Manager jobs in the United States?
bunny.net, AI (Artificial Intelligence) Incorporated, Confidential, Diploma Healthcare Group, Asset Inventories Inc., Render-Up, Digital Synergy Consulting, Inc. among others, are currently hiring for Manager roles in the United States.
The company with most openings is Leidos as they are hiring for 127 different IT Manager jobs in the United States. They are probably quite committed to find good IT Managers.
The company with most openings is Leidos as they are hiring for 127 different IT Manager jobs in the United States. They are probably quite committed to find good IT Managers.