1684 IT & Software Developer jobs in the US
Data Engineer - Kafka
$141,000 - 181,000
Brains Workgroup, Inc.
East 78th Street 1, New York
$141,000 - 181,000
Requirements
Must:
- Bachelors degree in Computer Science, Engineering, or a related discipline.
- Demonstrated experience in Kafka administration and management.
- In-depth knowledge of OpenShift and container orchestration.
- Proficient in scripting languages such as Python or Bash.
- Familiarity with monitoring and logging tools, such as Splunk, Prometheus, and Grafana.
- Strong analytical skills and meticulous attention to detail.
- Excellent verbal and written communication skills with the ability to collaborate effectively.
- Preferred: Experience in Red Hat OpenShift administration.
- Preferred: Understanding of service mesh patterns like Istio or OpenShift Service Mesh.
- Preferred: Knowledge of stream processing frameworks such as Kafka Streams, ksqlDB, or Flink.
- Preferred: Background in utilizing observability stacks (Prometheus, Grafana).
- Preferred: Experience in regulated or large-scale enterprise environments.
- Preferred: Familiarity with DevOps practices and tools (like ArgoCD, Ansible, Terraform).
- Preferred: Knowledge of SRE monitoring and logging tools (e.g., Splunk, Prometheus, Grafana).
Responsibilities
- Design, deploy, and manage AMQ Streams (Kafka) clusters on Red Hat OpenShift.
- Configure and oversee Kafka components, including brokers, Kraft, MirrorMaker 2, and Schema Registry.
- Ensure optimal performance, reliability, scalability, and high availability of the Kafka platform.
- Implement cluster monitoring, logging, and alerting with enterprise-level observability tools.
- Handle capacity planning, partition strategies, retention policies, and performance optimization.
- Define and document standardized event-driven integration patterns such as event sourcing and CQRS.
- Guide application teams in adopting appropriate patterns aligned with enterprise architecture.
- Establish best practices for schema design, topic governance, and message lifecycle management.
- Implement comprehensive security measures for Kafka, including RBAC, TLS, ACLs, and integration with authentication protocols.
- Maintain governance for topic creation and ensure compliance with data protection requirements.
- Provide guidance and troubleshooting support to development and integration teams.
- Collaborate with architects and developers to promote the adoption of event-driven architectures.
- Create documentation and internal knowledge-sharing resources to assist teams.
- Build and maintain GitOps workflows utilizing Argo CD for Kafka resource deployment.
- Develop CI/CD pipelines in GitLab to automate builds and configuration across environments.
- Maintain Infrastructure-as-Code (IaC) repositories for Kafka resources.
Description
We are a leading bank located in New York City, currently seeking a talented Data Platform Engineer to join our dynamic team. This permanent position offers a competitive compensation package, including a salary range of $120,000 to $150,000, excellent benefits, and a target bonus. Our ideal candidate will have the opportunity to collaborate with application teams, ensuring the development of a robust and efficient event-streaming platform while working in a vibrant office environment.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find Data Engineer salaries in the United States here.
How many Data Engineer jobs are in the United States?
Currently, there are 1684 Data openings. Check also: Spark jobs, Snowflake jobs, Kafka jobs, Hadoop jobs - all with salary brackets.
Is the US a good place for Data Engineers?
The US is one of the best countries to work as a Data Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.
Which companies are hiring for Data Engineer jobs in the United States?
Jump, Sched LLC, D3 Security Management Systems, Meitou Inc., Boulons Plus, Snaplii, Airia Brands Inc among others, are currently hiring for Data roles in the United States.
The company with most openings is Boeing as they are hiring for 60 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.
The company with most openings is Boeing as they are hiring for 60 different Data Engineer jobs in the United States. They are probably quite committed to find good Data Engineers.