Senior Machine Learning Kernel Performance Engineer

At Amazon Web Services (AWS), our Annapurna Labs team is engaged in developing AWS Neuron, a software development kit aimed at enhancing deep learning and generative AI workloads on Amazon’s specialized machine learning accelerators, Inferentia and Trainium. The Acceleration Kernel Library team is central to maximizing performance for our unique ML accelerators. Our engineers, operating at the hardware-software interface, create high-performance kernels for machine learning functions, ensuring optimal performance for our customers’ complex workloads. We merge in-depth hardware insights with ML know-how to redefine the potential of AI acceleration. The AWS Neuron SDK, created by our Annapurna Labs team, provides the foundation for expediting deep learning and GenAI workloads on Inferentia and Trainium. This extensive toolkit encompasses an ML compiler, runtime, and application framework that integrates smoothly with well-known ML frameworks like PyTorch to deliver exceptional ML inference and training performance. As part of the larger Neuron Compiler organization, our team collaborates across various technology layers—from frameworks and compilers to runtime and collectives. We not only enhance current performance but also contribute to future architectural designs by closely collaborating with customers to implement their models and ensure peak performance. This position offers a distinct opportunity to work at the convergence of machine learning, high-performance computing, and distributed architectures, allowing you to influence the future of AI acceleration technology. We value diversity in experiences at AWS and encourage all candidates to apply, even if they do not meet every single qualification. Our culture embodies inclusion, supported by numerous employee-led affinity groups and continuous learning opportunities. We prioritize work-life balance, offering flexible working hours, and are dedicated to mentorship and career growth within our team. The role promises to be a rewarding journey in terms of learning and professional development as we build innovative solutions together. We look forward to considering your application as we seek to enhance our exceptional culture and contributions to the cloud computing landscape!