Job Post: Consultant – Java with Kafka
Company: Coherent Pixel Systems
Role: Consultant – Java with Kafka
Experience: 5 – 9 Years
Location: Remote
Work Mode: Fully Remote
Job Summary
Coherent Pixel Systems is looking for an experienced Java Developer with Kafka to design, develop, and maintain high-performance data ingestion and transformation pipelines. The ideal candidate should have strong expertise in Java, Apache Kafka, Apache NiFi, and ETL processes, with the ability to work in a fast-paced, data-driven environment.
Primary Skills
- Java
- Apache Kafka
- Apache NiFi
- ETL Pipeline Development
Good to Have
- Experience with Rules Processing Engine (RPE)
- Data Transformation Tools
- Experience with Bloblang-based parsing and transformation (Benthos/Redpanda)
Key Responsibilities
- Develop and maintain scalable data ingestion and ETL pipelines.
- Design, configure, and optimize Bloblang-based parsing and transformation logic within Redpanda/Benthos pipelines.
- Execute and manage Data Management (DM) and Rules Processing Engine (RPE) batch processes.
- Monitor, troubleshoot, and resolve database and pipeline-related issues to ensure data accuracy and processing efficiency.
- Collaborate with engineering and data teams to improve pipeline performance and implement new data requirements.
- Ensure compliance with data quality, security, and operational best practices.
- Support QA teams during testing by validating pipelines, analyzing defects, and verifying data accuracy.
- Work closely with the product team to identify issues, support testing activities, and ensure timely delivery of pipeline-related features.
- Provide support for environment-related issues, including server downtime, system interruptions, and restoration activities.
Preferred Candidate Profile
- 5–9 years of experience in Java-based application development.
- Strong hands-on experience with Apache Kafka and Apache NiFi.
- Experience in designing and supporting ETL/data processing pipelines.
- Good understanding of database operations and data transformation techniques.
- Strong analytical, troubleshooting, and communication skills.
- Ability to work independently in a fully remote environment.
- Contact Details
Immediate Joiners Preferred
Drop Your CV:
[email protected]
[email protected]
[email protected]
Contact / WhatsApp:
9840125754
9840126408
Work Location: Remote
