1203 IT & Software Developer jobs in the US
Senior Big Data Engineer - Property Claims
$85,600 - 152,650
Allstate
Sanders Road 3100, Arizona
$85,600 - 152,650
Requirements
Must:
- Strong coding proficiency in Python and SQL, with experience in multiple database types preferred.
- Quick adaptability or proven expertise in Azure services including Event Hub, ADLS, Azure SQL MI, and Function Apps.
- Knowledge of Infrastructure as Code (Terraform) and CI/CD processes using GitHub/Env0.
- Familiarity with Microsoft Fabric, particularly Lakehouse, Pipelines, and Real-Time Analytics.
- Experience in constructing ETL/ELT pipelines across diverse data platforms.
- Background in working with APIs, file ingestion methods, or vendor integrations.
- Ability to function efficiently in a hybrid cloud and on-premises environment.
- Strong analytical, problem-solving, and communication skills.
Responsibilities
- Design, implement, and maintain Azure cloud resources, including ADLS Gen2 and Azure SQL Managed Instances.
- Create and manage infrastructure-as-code deployments utilizing Terraform and Env0 with a GitHub-focused CI/CD approach.
- Develop and support native Fabric integrations for data ingestion and event streaming.
- Engineer secure integrations with cloud vendors using OAuth and event streaming methods.
- Enhance a high-performance on-prem Linux server for ETL processes and real-time data handling.
- Create and manage Python ETL pipelines via Airflow, interacting with various data sources.
- Construct reusable Python libraries for API integrations, file processing, and scheduled data orchestration.
- Ensure reliability and performance optimization of on-premise data services.
- Build comprehensive Big Data solutions to facilitate analytics and automated reporting.
- Identify and incorporate new data sources and technologies to advance operational insights.
- Collaborate with internal teams and external vendors to deliver holistic data solutions.
- Lead complex technical initiatives while providing specialized engineering insights for critical projects.
Description
At Allstate, our mission is to collaborate effectively to safeguard families and their possessions from lifes unpredictability. With over 90 years of experience, we have consistently innovated to meet our customers changing expectations, from safety advocacy to advancements in technology and identity protection. We are looking for a Property Claims Big Data Engineer Senior Consultant II to play a pivotal role in our cloud-first data modernization strategy, working with Microsoft technologies. This position offers a competitive salary range located in a collaborative and dynamic environment, allowing you to make a significant impact while advancing your career.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the United States here.
How many Data Engineer jobs are in the United States?
Currently, there are 1203 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the US a good place for Data Engineers?
The US is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the United States?
Jump, Snaplii, D3 Security Management Systems, Skycope C-UAS Technologies Inc, Deloitte, D9Tech Resources, LLC, Sedulous Consulting Services LLC among others, are currently hiring for Data roles in the United States.
The company with most openings is Rural King Supply as they are hiring for 394 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.
The company with most openings is Rural King Supply as they are hiring for 394 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.