840 IT & Software Developer jobs in the US
Software Engineering Manager, LLM Inference Model Development
$166,400 - 287,700
Annapurna Labs (U.S.) Inc.
Torre Avenue 10201, Cupertino
$166,400 - 287,700
Requirements
Must:
- A minimum of 3 years of experience managing engineering teams.
- At least 7 years of hands-on experience working directly within engineering teams.
- Over 3 years of experience in designing or architecting new and existing systems, including design patterns, reliability, and scaling.
- Proven ability to collaborate with product or program management teams.
Responsibilities
In the role of Software Development Manager (SDM) for the LLM Inference Model Enablement team, I will lead a team of skilled AI/ML engineers to onboard and enhance cutting-edge open-source and customer large language models (LLMs), including both dense and Mixture of Experts (MoE) models, for inference on Neuron and Trainium. I will focus on driving improvements in the speed and experience of model enablement while enhancing the usability and quality of inference through features, infrastructure optimization, tools, and automation. My day-to-day will involve collaborating with senior management and technical leaders to define model enablement and performance optimization for the latest state-of-the-art (SOTA) LLMs, along with overseeing the team in improving the model onboarding experience and enhancing inference usability and quality for Neuron-supported models. I will adeptly manage shifting priorities as new models and technologies emerge and guide my team in overcoming technical challenges.
Description
At Amazon Web Services (AWS), we take pride in being the world’s most comprehensive and widely utilized cloud platform, continuously innovating and providing trusted solutions to customers ranging from burgeoning startups to Fortune 500 companies. We deeply value unique experiences; if you feel your background doesn’t align perfectly with the listed qualifications, we still encourage you to apply. Our culture prioritizes work-life balance, ensuring that success at work does not come at the expense of personal life. We strive for flexibility in our working environment, promoting support at home and in the workplace. We are committed to mentorship and career advancement, actively fostering knowledge sharing and resources to help our employees grow as professionals. Moreover, we are an equal opportunity employer, dedicated to creating an inclusive culture. If you require workplace accommodations during the application or hiring process, please reach out to us. The compensation for this role ranges from $166,400 to $287,700 annually, depending on market location, job-related knowledge, skills, and experience. Additional compensation may include equity, sign-on bonuses, and a wide array of benefits.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find IT Manager salaries in the United States here.
How many IT Manager jobs are in the United States?
Currently, there are 840 Manager openings. Check also: CTO jobs, ERP jobs, Architect jobs - all with salary brackets.
Is the US a good place for IT Managers?
The US is one of the best countries to work as a IT Manager. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for IT Manager jobs in the United States?
Sperasoft, New World Technologies Inc., Giesecke+Devrient, Archon Systems Inc, Puter Technologies Inc., HAPLY Robotics Inc., LGS, une Société IBM / an IBM Company among others, are currently hiring for Manager roles in the United States.
The company with most openings is Leidos as they are hiring for 89 different IT Manager jobs in the United States. They are probably quite committed to find good IT Managers.
The company with most openings is Leidos as they are hiring for 89 different IT Manager jobs in the United States. They are probably quite committed to find good IT Managers.