1663 IT & Software Developer jobs in the US
Data Engineer with SQL and Python expertise
$80,000 - 120,000
Iprime Info Solutions Inc
West 67th Street, Shawnee Mission
$80,000 - 120,000
Requirements
Must:
- Masters degree in Computer Science, Engineering, Technology, Management, or a related field
- Proven experience in designing and managing scalable batch and streaming Dataflow jobs
- Proficient in developing Big Data applications using Hadoop, Hive, PySpark, and Python
- Familiarity with building centralized logging systems and integrating Dataflow logs with Cloud Logging
- Strong skills in SQL and BigQuery for data transformation and analytics
- Knowledge of Pub/Sub for dependable data ingestion
- Experience in automating data workflows with Cloud Functions
- Ability to conduct large-scale data analysis using Python and Pandas
- Experience collaborating in Agile teams and following DevOps best practices
Responsibilities
- Design and manage scalable batch and streaming Dataflow jobs for processing both historical and real-time data
- Develop Big Data applications using various tools and technologies including Hadoop, Hive, PySpark, and Python
- Construct and implement centralized logging systems to integrate Dataflow logs with Cloud Logging for effective monitoring and troubleshooting
- Utilize SQL and BigQuery for the purposes of data transformation and analytics
- Leverage Pub/Sub for reliable data ingestion processes
- Automate data workflows utilizing Cloud Functions
- Perform extensive data analysis at scale using Python and Pandas
- Collaborate within Agile teams, adhering to DevOps best practices for deployment and ongoing monitoring
- Travel to various client sites across the USA as required
Description
At Iprime Info Solutions Inc, we are excited to announce openings for the Data Engineer position. We offer a dynamic work environment located in Overland Park, KS, and provide opportunities for professional growth and collaboration within Agile teams. Our company prides itself on following the best practices in DevOps, ensuring that our employees are equipped with the necessary skills to thrive. We value innovation and encourage our employees to contribute to the development of robust Big Data solutions. Additionally, the role may involve occasional travel to various unanticipated client worksites throughout the USA.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the United States here.
How many Data Engineer jobs are in the United States?
Currently, there are 1663 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the US a good place for Data Engineers?
The US is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the United States?
Jump, Sched LLC, D3 Security Management Systems, Meitou Inc., Boulons Plus, Snaplii, Airia Brands Inc among others, are currently hiring for Data roles in the United States.
The company with most openings is Boeing as they are hiring for 56 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.
The company with most openings is Boeing as they are hiring for 56 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.