1346 IT & Software Developer jobs in the US
Lead Data Engineer - Spark & Python
$176,400 - 197,600
Eliassen Group
Walkers Brook Drive 55, Almont
$176,400 - 197,600
Requirements
Must:
- Extensive experience in designing and overseeing ETL workflows using IBM DataStage.
- Proficient in SQL, with advanced skills in performance tuning, complex joins, windowing, and optimization for large data volumes.
- Strong proficiency in Python for automation, validation scripts, and transformation logic.
- In-depth experience with mapping, cleansing, deduplication, validation, and reconciliation of large datasets.
- Solid understanding of data governance including data quality rules, lineage, controls, and auditing requirements.
- Comprehensive knowledge of the Salesforce data model, including objects, relationships, lookups, constraints, and metadata.
- Experience in leading migrations using Data Loader, Bulk API, or other Salesforce ingestion tools.
- Skilled in devising load ordering strategies and resolving hierarchical or relational dependencies.
- Proven track record in managing data migration workstreams or teams.
- Ability to drive technical decisions and provide mentorship to engineers.
- Excellent communication skills and ability to align with stakeholders.
- Familiarity with banking, regulatory, or compliance-driven data migrations (preferred).
- Experience with nCino (preferred).
- Exposure to cloud data platforms such as Snowflake, Azure, or AWS for staging or pre-processing (preferred).
- Understanding of CI/CD processes for scheduling DataStage or ETL pipelines (preferred).
Responsibilities
- Lead the comprehensive technical design of Salesforce migration pipelines, focusing on load strategies, sequencing dependencies, staging architectures, and data quality measures.
- Act as the chief technical decision-maker for mapping logic, transformation patterns, validation methods, and design using DataStage or Python ETL.
- Provide oversight, reviews, and approval for mapping documents, data cleansing guidelines, and ETL workflows created by engineers.
- Coordinate and supervise profiling, mapping, extraction, transformation, cleansing, mock runs, remediation, final loads, and post-load reconciliation processes.
- Spearhead the development of repeatable migration templates including mapping patterns, validation scripts, transformation libraries, and reconciliation frameworks.
- Diagnose and resolve complex DataStage ETL issues, load failures, and Salesforce API limitations.
- Collaborate with Salesforce architects regarding object load order, relationship management, and platform limitations.
- Engage with business Subject Matter Experts (SMEs) to validate mapping logic, address data challenges, and approve reconciliation reports.
- Liaise with Salesforce, infrastructure, release management, and governance teams to synchronize dependencies and cutover planning.
- Define and maintain data validation standards, data quality acceptance levels, rejection criteria, and reconciliation metrics.
- Ensure adherence to metadata, lineage, audit, and regulatory compliance standards.
- Manage defect processes for mock runs and ensure prompt resolution of root causes.
- Oversee and endorse the migration runbook, inclusive of workflows, safeguards, schedules, rollback strategies, and support procedures.
- Mentor developers and analysts in transformation logic, troubleshooting, and best practices for migration engineering.
- Make critical decisions on defect triage and remediation, leading final production load execution and validation.
Description
We are a prominent financial institution based in Cincinnati, Ohio, renowned for our extensive branch and ATM network across multiple states. As a Fortune 500 company, we are among the largest banks in the U.S., with a rich history that traces back to the early 1900s. To meet our client requirements, we seek candidates who can work on a W2 basis, offering an attractive benefits package that includes medical, dental, and vision coverage, a 401k plan with company matching, as well as life insurance. Join our team and contribute to our mission of delivering exceptional financial services.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the United States here.
How many Data Engineer jobs are in the United States?
Currently, there are 1346 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the US a good place for Data Engineers?
The US is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the United States?
Multimatic Inc., Gobind Sarvar School Calgary, Canadian Appliance Source, DataAnnotation, The Computer Company, Inc, Vestmark, Inc., Quantam Solutions among others, are currently hiring for Data roles in the United States.
The company with most openings is Jobot as they are hiring for 202 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.
The company with most openings is Jobot as they are hiring for 202 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.