551 IT & Software Developer jobs in the US
Senior Software Engineer - AI Integrations
$130,000 - 170,000
Ace Software Consulting Inc.
161 Secretariat Ct, Remote + Remote (US)
$130,000 - 170,000
Requirements
Must:
- Strong backend experience (5+ years) in developing microservices using Python and/or Node.js.
- Proficient in AI integrations: creating APIs that interface with LLMs, generate embeddings, and execute vector searches.
- Skilled in implementing RAG pipelines, knowledge-base connectors, and vectorization workflows.
- Knowledgeable about LLM orchestration methods: prompt chaining, agent frameworks, multi-step reasoning flows, and action/tool invocation.
- Practical experience working with AWS Bedrock or similar managed LLM services at the production level.
- Solid foundation in API design, including authentication/authorization, retry/backoff patterns, and rate-limiting techniques.
- Familiar with at least one vector store (e.g., Pinecone, Milvus, Weaviate, or vector databases on AWS/Aurora with pgvector) and related retrieval techniques.
- Demonstrated success in delivering production services with CI/CD, automated testing, and monitoring.
Responsibilities
- Design, create, and maintain backend microservices and APIs using Python and Node.js (REST/GraphQL/gRPC).
- Develop AI-integration layers, including embedding generation, vectorization, vector search, knowledge-base connectors, and RAG pipelines.
- Connect with LLM and model-hosting platforms (AWS Bedrock and similar), implementing prompt chaining and agent orchestration.
- Build, test, and manage AI agent frameworks to facilitate multi-step, stateful workflows and task delegation.
- Create event-driven and serverless components for scaling real-time inference and asynchronous tasks.
- Ensure services meet production standards: automated CI/CD, Infrastructure-as-Code, logging, tracing, and alerting.
- Collaborate with data scientists, ML engineers, product owners, and security teams to deploy models and establish guardrails (content filtering, rate limits, auditing).
- Optimize model call costs, latency, throughput, embedding pipelines, and vector-index maintenance.
- Generate comprehensive API documentation, runbooks, and design documents; engage in architectural reviews.
Description
We are seeking to expand our team with a backend engineer who excels in designing and implementing resilient, secure, and observable microservices in Python and Node.js. Our work involves close integration with AI platforms, knowledge bases, and the latest model orchestration frameworks, all within a collaborative remote environment. We offer competitive paid time off along with a supportive team atmosphere where innovation thrives.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find DevOps salaries in the United States here.
How many DevOps jobs are in the United States?
Currently, there are 551 DevOps openings. Check also: Cloud jobs, AWS jobs, Azure jobs, GCP jobs, Kubernetes jobs, Docker jobs, Terraform jobs - all with salary brackets.
Is the US a good place for DevOps?
The US is one of the best countries to work as a DevOps. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for DevOps jobs in the United States?
Murmuration, Snaplii, LawDepot, Theragraph Inc., DataDis Inc, Kane Partners LLC, Johnson Health Tech North America Inc among others, are currently hiring for DevOps roles in the United States.
The company with most openings is Intuit as they are hiring for 96 different DevOps jobs in the United States. They are probably quite committed to find good DevOps.
The company with most openings is Intuit as they are hiring for 96 different DevOps jobs in the United States. They are probably quite committed to find good DevOps.