2627 IT & Software Developer jobs in the US
PySpark Developer
$120,000 - 130,000
Judge Group, Inc.
Park Central Drive 12700, Irving
$120,000 - 130,000
Requirements
Must:
- 5-10 years of hands-on experience in PySpark and Apache Spark development.
- Strong understanding of Spark RDDs, DataFrames, Spark SQL, and performance optimization.
- Expertise in Python with the ability to implement intricate data transformations.
- Solid SQL capabilities with experience managing large datasets.
- Knowledge of object-oriented programming, unit testing, and debugging.
- Experience with scheduling tools such as Airflow, Cron, or equivalent.
- Strong analytical and troubleshooting skills for addressing data pipeline issues.
Responsibilities
- Design, enhance, and sustain data pipelines and ETL workflows utilizing Apache Spark and PySpark.
- Utilize advanced knowledge of Spark core concepts, performance tuning, and industry best practices.
- Convert business requirements into scalable and dependable data transformations.
- Collaborate with analysts and stakeholders to comprehend data requirements and deliver innovative solutions.
- Develop and maintain unit tests, adhere to OOP principles, and uphold high code quality standards.
- Create complex SQL queries to extract insights from extensive datasets.
- Schedule, orchestrate, and monitor data transformation jobs based on business needs.
- Conduct root-cause analysis on pipeline failures, resolve data quality challenges, and implement corrective measures.
- Ensure the integrity, reliability, and availability of data across the ecosystem.
Description
We are looking for a skilled PySpark Developer to join our team in Irving, TX, with a competitive salary range of $120,000 to $130,000 annually. Our ideal candidate will possess extensive experience in data engineering, particularly with designing, building, and optimizing scalable data pipelines. You will collaborate closely with business analysts and stakeholders to deliver top-notch data solutions that enhance our analytics and business intelligence efforts. Join us for an opportunity to work on complex datasets and make impactful contributions.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Python Developer salaries in the United States here.
How many Python Developer jobs are in the United States?
Currently, there are 2627 Python openings. Check also: Django jobs, Flask jobs, TensorFlow jobs, Machine-Learning jobs - all with salary brackets.
Is the US a good place for Python Developers?
The US is one of the best countries to work as a Python Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Python Developer jobs in the United States?
AMERICAN SYSTEMS, Trimlite, Menusifu, Inc., Concordia Group, Peraton, Active Datacomm, DreamPak among others, are currently hiring for Python roles in the United States.
The company with most openings is Lockheed Martin Corporation as they are hiring for 244 different Python Developer jobs in the United States. They are probably quite committed to find good Python Developers.
The company with most openings is Lockheed Martin Corporation as they are hiring for 244 different Python Developer jobs in the United States. They are probably quite committed to find good Python Developers.