3212 IT & Software Developer jobs in the US
Senior Big Data Engineer
$140,000 - 160,000
TEKsystems c/o Allegis Group
West Kennedy Boulevard 4890, Tampa + Remote
$140,000 - 160,000
Requirements
Must:
- 10+ years of experience in a Senior Data Engineer or Big Data Engineer role, adept at developing data pipelines.
- 2-3+ years of experience on the Databricks platform and Medallion Architecture, performing tasks such as:
- Autoloading
- Lake Flow Connections
- Managing Clusters, Catalogs, and Workspaces
- Building CI/CD Pipelines
- Implementing Data Masking
- Handling Data Streaming
- 5+ years of experience with AWS cloud technologies, Azure experience acceptable.
- 5+ years of proficiency in Python, PySpark, and PySQL.
- Collaborative approach to work with cross-functional teams and stakeholders from business and IT.
- Strong understanding of the HealthCare domain (Health Insurance, Pharmacy, etc.) and knowledge of HIPAA guidelines regarding PHI/PII for Data Masking.
- Financial Experience is acceptable if HealthCare/PHI experience is lacking.
Responsibilities
- Design and create scalable data pipelines utilizing Delta Lake, managing enterprise data access, security, and lineage through Unity Catalog.
- Optimize large-scale Spark jobs (PySpark/SQL) and cluster configurations (Photon) to meet strict SLA and cost performance targets across workflows.
- Build reliable data scheduling via Databricks Workflows (Jobs) and establish automated CI/CD pipelines for seamless code promotion across Development, Staging, and Production environments.
- Migrate data and models from relational databases to the Databricks platform.
- Ensure development adheres to industry-standard best practices.
- Monitor the performance of data pipelines continuously.
- Collaborate with Data Management and Full Stack development engineers to operationalize models within current applications and processes.
- Provide support for existing data pipelines to ensure business continuity.
- Stay informed about the latest trends and technologies in data engineering and cloud computing.
- Perform other related tasks as required.
Description
We are TEKsystems, partners in transformation, helping clients activate innovative ideas and solutions to navigate a new world of opportunity. Our team of 80,000 strong collaborates with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe, and Asia. As leaders in Full-Stack Technology Services and Talent Services, we drive change alongside progressive leaders. This permanent position is fully remote, with an anticipated salary range of $140,000 to $160,000 annually. Benefits are available upon request.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the United States here.
How many Data Engineer jobs are in the United States?
Currently, there are 3212 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the US a good place for Data Engineers?
The US is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the United States?
Transport-Bourassa, Allied Technical Solutions, KUBRA, D3 Security Management Systems, GINGER Telecom, Gatestone & Co. Inc, ID Cosmetic clinic among others, are currently hiring for Data roles in the United States.
The company with most openings is Lockheed Martin Corporation as they are hiring for 267 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.
The company with most openings is Lockheed Martin Corporation as they are hiring for 267 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.