1503 IT & Software Developer jobs in the US
Data Engineer with SQL and Python
$108,000 - 148,000
Surgery Partners
Commerce Street 401, Nashville
$108,000 - 148,000
Requirements
Must:
- Over 5 years of experience in contemporary data engineering roles
- Mastery of PySpark and Spark SQL
- Proficient in Databricks, including Jobs, Workflows, Repos, and Delta Live Tables
- Strong knowledge of Delta Lake architecture and transactional design paradigms
- Hands-on experience with Azure Data Factory or Azure Synapse Pipelines
- Expertise in cloud-native data security practices (RBAC, ABAC, privilege boundary enforcement)
- Solid experience with healthcare data formats such as FHIR (JSON), HL7 v2/v3, and X12 EDI claims data
- In-depth understanding of distributed systems, data partitioning strategies, concurrency, and cluster resource optimization
Responsibilities
- Create and implement scalable data processing architectures using Databricks Runtime, Delta Lake transactions, and Unity Catalog
- Design and maintain a medallion (Bronze/Silver/Gold) architecture, ensuring schema evolution and error-handling strategies
- Build high-performance ingestion frameworks for various healthcare data message streams and source systems
- Develop and manage data pipelines utilizing Azure Data Lake Storage Gen2 and Azure Event Hubs
- Implement enterprise-grade security and manage secrets through Azure Key Vault
- Optimize PySpark and Scala pipelines, including leveraging advanced Spark techniques
- Maintain high-volume batch ETL and low-latency streaming pipelines
- Establish CI/CD practices for Databricks environments, focusing on automated job deployments and testing
- Ensure compliance with HIPAA and other healthcare-related regulations through secure PHI pipelines
- Support and track healthcare data standards throughout the data lifecycle
Description
We are seeking a highly skilled Data Engineer for a hybrid opportunity at our corporate office in Brentwood, TN, requiring on-site work from Monday to Wednesday. In this role, you will design and implement advanced data ingestion pipelines critical for analytics and clinical insights in a large-scale healthcare environment. We offer comprehensive benefits, including health, dental, and vision insurance, a health savings account, life insurance, paid time off, a 401(k) retirement plan with company matching, and more. Join our team and contribute to impactful projects in data engineering within the healthcare sector.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the United States here.
How many Data Engineer jobs are in the United States?
Currently, there are 1503 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the US a good place for Data Engineers?
The US is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the United States?
Multimatic Inc., Snaplii, Novatek International, T&S Brass and Bronze Works, Inc, Vohra Wound Physicians, Advanced Digital Data, Inc., Osmose Utilities Services among others, are currently hiring for Data roles in the United States.
The company with most openings is Jobot as they are hiring for 273 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.
The company with most openings is Jobot as they are hiring for 273 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.