663 IT & Software Developer jobs in the US
Software Engineer - Tester (Big Data, Cloudera)
$92,000 - 147,000
Mastercard
Mastercard Boulevard 2200, O'Fallon
$92,000 - 147,000
Requirements
Must:
###
- 3–5 years of practical experience in software testing or QA engineering, particularly within Big Data settings.
- Proficiency in one or more programming languages: Python, Java, Scala, or Bash.
- Experience with testing big-data applications leveraging Kafka, Spark, Cloudera/Hadoop, HBase, Hive, Solr, NiFi, Hue, or Livy.
- Hands-on experience validating NiFi pipelines, including processors and flow logic.
- Strong capability in automation frameworks for testing (API, backend, ETL/data validation).
- Familiarity with UI automation using Selenium.
- Skills in SQL and NoSQL data validation tasks.
- Experience with Jenkins or similar CI/CD tools.
- Availability to provide production support for applications as a developer/tester for two weeks in a rotated shift.
- Solid grasp of Agile/Scrum methodologies.
- Strong analytical, debugging, communication, and problem-solving abilities.
###
Responsibilities
- Test and validate distributed data engineering applications across Cloudera Manager components, such as Kafka, Spark, HBase, Hive, Solr, NiFi, Hue, Livy, and Unravel.
- Validate Apache NiFi pipelines by assessing processors, flow configurations, data lineage, and integration with downstream systems.
- Ensure the accuracy of ingestion pipelines, streaming jobs, batch ETL processes, orchestration flows, and REST APIs.
- Execute system, integration, functional, regression, and performance testing on large-scale data frameworks.
- Construct robust automation frameworks in languages like Python, Java, Scala, or Bash tailored to the codebase under test.
- Develop automation for validating Spark jobs, Kafka events, HBase/Hive schema, NiFi flow output, and comprehensive data pipeline coverage.
- Create automated tests for REST APIs, backend services, schema validations, and data accuracy.
- Build and uphold UI automation utilizing Selenium for internal tool dashboards like Hue and Livy UI.
- Enhance Jenkins CI/CD pipelines to enable automated test execution and continuous integration.
- Utilize Docker or similar environments for scalable test execution.
- Integrate automation suites into the build/release pipeline for smooth deployment processes.
- Confirm SQL queries, HBase tables, Hive datasets, Kafka streams, NiFi flow files, and NoSQL outputs meet quality standards.
- Maintain data accuracy, schema integrity, SLA compliance, and reliability of the end-to-end pipeline.
- Perform detailed validation of NiFi processors and their downstream integrations.
- Collaborate with Data Engineers, Big Data Platform Engineers, and QA team members to ensure thorough test coverage.
- Actively participate in Agile ceremonies, including story pointing, acceptance criteria definition, backlog refinement, sprint reviews, and retrospectives.
- Identify testing risks, recommend mitigation strategies, and advocate for quality-first practices within the team.
###
Description
We at Mastercard are dedicated to empowering economies and individuals across 200 countries and territories. Along with our clients, we strive to develop a sustainable economy that allows everyone to thrive. Our diverse digital payment solutions make transactions secure, straightforward, clever, and accessible. We leverage our technology, innovations, partnerships, and networks to provide an exclusive range of products and services that help individuals, businesses, and governments reach their utmost potential. We are an equal opportunity employer, committed to fostering a diverse environment and considering all applicants without discrimination based on gender, identity, sexual orientation, race, ethnicity, disability, veteran status, or any other legally protected characteristic. We seek to hire the best-qualified candidates for each role. In alignment with our comprehensive compensation philosophy, the successful candidate will receive a competitive base salary and may qualify for an annual bonus based on their role. The salary range may vary based on a number of factors, including location and relevant skills and experience. Our full-time employees generally enjoy benefits including medical insurance, paid leave, vacation time, and retirement options. Interns also receive paid sick leave and may have access to on-site fitness facilities.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find QA, Test Engineer salaries in the United States here.
How many QA, Test Engineer jobs are in the United States?
Currently, there are 663 QA, Test openings. Check also: Selenium jobs, Cypress jobs, Cucumber jobs - all with salary brackets.
Is the US a good place for QA, Test Engineers?
The US is one of the best countries to work as a QA, Test Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for QA, Test Engineer jobs in the United States?
Giesecke+Devrient, Surpass Solutions Inc, Calian Group, Univest Financial Corporation, Rock Solid Funding, TQL, Mercy Medical Center among others, are currently hiring for QA, Test roles in the United States.
The company with most openings is Leidos as they are hiring for 93 different QA, Test Engineer jobs in the United States. They are probably quite committed to find good QA, Test Engineers.
The company with most openings is Leidos as they are hiring for 93 different QA, Test Engineer jobs in the United States. They are probably quite committed to find good QA, Test Engineers.