2757 IT & Software Developer jobs in the US
Big Data Engineer (Hadoop/Athena)
$92,000 - 118,000
Software Guidance & Assistance
White Plains Road 220, Rockville
$92,000 - 118,000
Requirements
Must:
- 8+ years of experience in Big Data or Data Engineering.
- Extensive hands-on experience with AWS services including S3, Glue Data Catalog, Lake Formation, Athena, EMR, and EKS.
- Proven expertise in Trino (or Presto) with a focus on optimizing query performance.
- Familiarity with Kubernetes/EKS for managing data workloads.
- Proficient in SQL, Python, and shell scripting.
- Experience with CI/CD pipeline development and tools such as Jenkins.
- Background in building and configuring MCP servers for AI/ML integration.
- A proactive problem solver with an ownership mindset rather than just a task executor.
- Preferred exposure to AI/ML data pipelines.
- Experience in cloud-native data modernization.
Responsibilities
- Design and construct scalable data lakes and pipelines on AWS utilizing cloud-native and automated solutions.
- Enable rapid, federated analytics through Amazon Athena and Trino, including performance tuning for extensive queries.
- Manage metadata and schemas, facilitating discovery through AWS Glue Data Catalog.
- Implement fine-grained data access and governance using AWS Lake Formation alongside KMS encryption and SSL.
- Build and maintain data services on EKS (Kubernetes).
- Work within the Hadoop ecosystem, leveraging tools such as Spark, Hive, and HDFS with partitioning, bucketing, and columnar formats (Parquet, ORC).
- Troubleshoot and resolve complex issues related to big data pipelines, clusters, and queries.
- Design, implement, and sustain CI/CD pipelines using Jenkins or similar platforms.
- Monitor pipelines and clusters using CloudWatch and Grafana.
- Prepare high-quality datasets for AI/ML applications.
- Build, set up, and manage an MCP server for AI/ML integration.
- Collaborate within Scrum teams to proactively identify challenges and propose innovative, scalable solutions.
Description
We are SGA, a technology and resource solutions provider dedicated to excellence. As a women-owned business, our mission is to address significant IT challenges with a personal, tailored approach. Each year, we connect talented consultants like you with over 1,000 engagements. When we say lets work better together, we truly mean it. You will join a diverse team founded on core values of customer service, employee development, and high-quality integrity. We encourage authenticity and passion in the workplace. Our location is hybrid, offering flexibility across multiple sites including Tysons, VA, Rockville, MD, Jersey City, NJ, and Woodbridge, NJ. Join us in a fulfilling career while embracing your individuality.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the United States here.
How many Data Engineer jobs are in the United States?
Currently, there are 2757 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the US a good place for Data Engineers?
The US is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the United States?
AMERICAN SYSTEMS, Trimlite, Menusifu, Inc., Concordia Group, Peraton, Active Datacomm, DreamPak among others, are currently hiring for Data roles in the United States.
The company with most openings is Lockheed Martin Corporation as they are hiring for 260 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.
The company with most openings is Lockheed Martin Corporation as they are hiring for 260 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.