1654 IT & Software Developer jobs in the US
Web Scraping Engineer (Python, Data)
$64,000 - 104,000
Systems Plus, Inc.
Fillmore Park Trail, Arlington
$64,000 - 104,000
Requirements
Must:
- Minimum of 3 years of professional experience in web scraping or a related field
- Bachelors degree in Computer Science, Information Sciences, or a related IT discipline OR additional 10 years of relevant professional experience in lieu of degree
- Proficiency in Python and Java; experience with web scraping libraries such as BeautifulSoup, Scrapy, or Selenium
- Knowledge of AI/machine learning techniques for data extraction and classification
- Understanding of HTML, CSS, and JavaScript for navigating and interacting with websites
- Experience working with APIs and managing various data formats (JSON, XML, etc.)
- Familiarity with database systems and SQL for data storage and retrieval
- Knowledge of data cleaning and preprocessing techniques to ensure data integrity
- Strong problem-solving skills with an ability to troubleshoot and debug scraping issues
- Excellent communication and collaboration skills for effective teamwork
- Attention to detail with the capability to manage large volumes of data efficiently
- Preferred experience with cloud platforms for scalable web scraping infrastructure
- Familiarity with data visualization tools and techniques
- Understanding of legal and ethical considerations related to web scraping
- Security clearance: Secret
Responsibilities
- Support the development and maintenance of the web scraping infrastructure for the agency
- Extract data from various websites and APIs, ensuring accuracy and quality
- Develop and enhance web scraping scripts and tools for data extraction
- Collaborate with cross-functional teams to determine data requirements and implement scraping solutions
- Monitor and troubleshoot scraping processes to maintain data quality and accuracy
- Optimize scraping scripts for enhanced performance and efficiency, focusing on speed, scalability, and resource use
- Stay current with the latest web scraping techniques, tools, and industry best practices
- Perform data analysis and validation to maintain the integrity of scraped data
- Work together with data engineering and data science teams to integrate scraped data into existing data pipelines
- Document and communicate technical solutions, processes, and best practices to team members
Description
At Systems Plus, we pride ourselves on being a family-oriented company that genuinely cares about our employees and their growth. With over two decades of experience in providing Global Enterprise Management, Technology, Engineering, and Professional services across the Defense and Federal sectors, we hold numerous contracts worldwide. Our commitment to your success is reflected in our competitive benefits packages, salary offerings, bonus programs, and abundant opportunities for professional development. Based in Arlington, VA, with the flexibility for telework in the Metro DC area, we invite you to become a part of our innovative team and experience the difference at Systems Plus.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the United States here.
How many Data Engineer jobs are in the United States?
Currently, there are 1654 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the US a good place for Data Engineers?
The US is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the United States?
micro1, Vortex Solution, INNOVA Medical Ophthalmics Inc, Infovirtuel, Consultation Devpresso Inc, Varis Mine Technology Ltd, Tenet Advisors, LLC among others, are currently hiring for Data roles in the United States.
The company with most openings is Jobot as they are hiring for 139 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.
The company with most openings is Jobot as they are hiring for 139 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.