Website Apache Kafka
In the complex universe of data engineering, true expertise is rare. Even rarer is the specific, elite expertise required to bridge two powerful systems: Apache Kafka, the nervous system of modern data streaming, and OpenLink Endur, the beating heart of the energy trading world. Most contracts offer generic tasks; this one offers a mission-critical challenge.
This is not a role for a generalist. Publicis is seeking a single, highly specialized Kafka Subject Matter Expert (SME) for a 6+ month contract in Houston, TX. This hybrid role demands a professional with a deep, technical understanding of how to seamlessly interface Kafka with Endur’s complex architecture. If you possess this unique blend of skills, this is your arena. For others, it’s an opportunity that will simply pass you by.
The Mission: Architect the Data Bridge for Energy Trading
Your mission, should you choose to accept it, is to serve as the technical linchpin for a critical integration project. You will not be configuring Endur for traders or writing simple ETL scripts. You will be designing, developing, and maintaining the robust, high-throughput Kafka-based integration solutions that connect Endur to other vital third-party systems. Your work will ensure data integrity, consistency, and real-time flow at the core of energy trading operations.
Who We Are: The Team Behind the Mission
While the client is a major player (hinted to be in the energy sector due to the Endur requirement), you will be working with VSG Business Solutions, a firm connecting elite talent with critical projects. This role places you at the intersection of cutting-edge data technology and the high-stakes world of energy commodities, offering a unique challenge that few get to experience.
A Day in the Life: What You’ll Actually Do
This contract is hands-on, technical, and impactful. Your key responsibilities will include:
-
Designing & Developing Integration Solutions: Architecting and building reliable data pipelines and streaming solutions using Apache Kafka to interface directly with Endur.
-
Deep-Dive Technical Collaboration: Working closely with Endur technical teams to dissect and understand its data structures, database tables, and established integration patterns.
-
Cross-Functional Partnership: Collaborating with various teams to gather integration requirements and translate them into scalable, efficient technical solutions.
-
Ensuring System Integrity: Implementing safeguards and monitoring to guarantee data consistency and integrity across all integrated systems—a non-negotiable in trading environments.
-
Comprehensive Documentation: Creating detailed documentation on integration processes, data flows, and technical specifications for future maintenance and knowledge transfer.
The Non-Negotiable: Your Required Arsenal
We are looking for a proven expert. To be considered, you must possess this specific combination of skills and experience:
-
A Decade of Experience: 10-15 years of overall professional experience in data engineering or related fields, establishing a deep foundational knowledge.
-
Proven Kafka Mastery: 5+ years of proven expertise as a Kafka SME, with hands-on experience in:
-
Kafka Producers and Consumers
-
Topic and Partition management
-
Stream Processing
-
-
The Critical Specialty: Direct, hands-on experience integrating Kafka with OpenLink Endur. This is the core requirement. You must understand Endur’s technical architecture, specifically its data structures and tables.
-
Development Proficiency: Strong Java and/or Python development experience specifically within the context of Kafka implementations.
-
Work Authorization: This role is for US Citizens or Green Card holders only. We cannot accept OPT or H1B candidates for this contract position.
The “Ideal Candidate” Checklist: What Will Make You Shine
While the above is mandatory, these qualities will make you the undeniable top candidate:
-
Technical Tool Proficiency: Experience with Kafka Connect, Schema Registry, and monitoring platforms like Prometheus and Grafana.
-
Cloud Deployment Knowledge: Experience with cloud-based Kafka services like Confluent Cloud or AWS MSK (Amazon Managed Streaming for Kafka).
-
Industry Acumen: Knowledge of energy trading systems, workflows, and the critical nature of data within them.
-
Modern DevOps Practices: Exposure to CI/CD pipelines and DevOps practices, ensuring smooth integration and deployment.
-
Formal Credentials: A Bachelor’s degree or higher in a relevant field and any relevant Kafka or cloud certifications.
The Practical Details: Location, Duration, and Type
-
Job Title: Kafka Subject Matter Expert (SME)
-
Location: Houston, Texas (A major global hub for energy trading)
-
Work Model: Hybrid (3 days per week in the office)
-
Employment Type: Contract
-
Duration: 6+ months
-
Work Authorization: US Citizens or Green Card Holders only. No OPT/H1B.
How to Apply: Your Next Step is Simple
If this role aligns with your unique expertise, we strongly encourage you to apply. The process is direct:
-
Update Your Resume: Ensure it highlights your specific, quantifiable experience with Kafka and, most importantly, your direct integration work with Endur.
-
Craft a Brief Cover Note: In your email, succinctly explain why your Kafka and Endur integration experience makes you the ideal candidate.
-
Submit Your Application: Email your resume and cover note directly to the recruiter:
-
Subject Line: Kafka SME with Endur Experience – [Your Name]
-
Recruiter Contact: Prince Dhirya | 609-732-1275
To apply for this job please visit kafka.apache.org.