1245 IT & Software Developer jobs in the US
Requirements
Must:
- Extensive experience as an Amazon Data Engineer with a minimum of 10 years in the field.
- Proficient in AWS Data Engineering, specifically with Amazon S3 and Shell Scripting.
- Demonstrated ability to design, develop, and implement data pipelines.
- Skilled in executing test cases to ensure data integrity and quality.
- Strong understanding of ETL workflows and data management principles.
- Familiarity with advanced Amazon S3 features such as versioning and lifecycle policies.
- Experience with scripting languages like PySpark and Shell for data automation.
- Ability to troubleshoot data-related issues effectively.
- Excellent communication skills for working with cross-functional teams.
- Knowledge of Hadoop or Spark is a plus.
- Competence in validating HiveQL and HDFS structures within Hadoop clusters.
- Strong analytical and problem-solving skills.
- Background in Metadata dependent ETL processes and batch/job frameworks.
Responsibilities
- Design, develop, and implement data pipelines while executing test cases to ensure data quality.
- Create, optimize, and manage data pipelines that utilize Amazon S3 for efficient data storage and processing in ETL workflows.
- Employ Amazon S3 for data storage and management, including scripting for data transfers between systems.
- Utilize features of Amazon S3, including versioning and access controls, for secure data management.
- Write and maintain scripts (using PySpark, Shell, or similar) to automate data movement between Amazon S3 and other platforms, ensuring performance.
- Collaborate with various teams to address and resolve data-related problems using S3s functionalities.
- Document ETL processes and maintain relevant technical documentation while adhering to best practices for data management in Amazon S3 environments.
- Validate data structures and processing within Hadoop clusters when necessary.
Description
We are seeking a full-time Amazon S3 Engineer based in Charlotte, NC or Plano, TX, who will play a crucial role in our data engineering team. In this position, you will design and develop data pipelines that utilize Amazon S3 for scalable data storage and retrieval. We offer a collaborative work environment with opportunities for professional growth and development. Join us as we leverage advanced data technologies to ensure high quality and secure data management across our projects.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the United States here.
How many Data Engineer jobs are in the United States?
Currently, there are 1245 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the US a good place for Data Engineers?
The US is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the United States?
Jump, Sched LLC, DataAnnotation, AMS Networks LLC, Hi-Temp Insulation, NewCold, MTech Systems among others, are currently hiring for Data roles in the United States.
The company with most openings is Jobot as they are hiring for 50 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.
The company with most openings is Jobot as they are hiring for 50 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.