Job Responsibilities:
- Design, develop, and maintain scalable data flows using Apache NiFi to support post-trade processing and data distribution.
- Build robust ingestion, transformation, and routing pipelines for both structured and unstructured financial data.
- Integrate NiFi with internal and external systems, including APIs, messaging platforms, and databases.
- Optimize NiFi performance (throughput, latency, back-pressure, clustering) for high-volume trading environments.
- Implement monitoring, alerting, and troubleshooting for production data pipelines to ensure reliability and uptime.
- Ensure data quality, lineage, governance, and compliance with financial regulations.
- Develop reusable processors, templates, and frameworks to standardize data integration patterns.
- Collaborate with data architects, platform engineers, and business stakeholders to translate requirements into technical solutions.
- Lead code reviews, enforce engineering best practices, and mentor junior developers.
- Support deployment, release management, and production issue resolution.
Essential Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 10+ years of extensive experience in Java development and leading software projects.
- Strong expertise in Java, Spring Boot, Hibernate, Kubernetes, and Docker.
- Hands-on experience with Apache NiFi, including processors, controllers, flow design, and clustering.
- Deep knowledge of ETL/ELT and real-time data streaming architectures.
- Experience with messaging systems, particularly Kafka, and RESTful APIs.
- Solid background in SQL and both relational and non-relational databases.
- Familiarity with Linux/Unix environments and scripting languages.
- Experience with cloud platforms, especially AWS.
- Understanding of data formats (JSON, XML, Avro, CSV) and data transformation techniques.
Desired Experience:
- 5+ years of experience in data engineering or integration roles.
- Experience in capital markets, trading platforms, or post-trade processing systems is preferred.
- Knowledge of trade lifecycle, settlement, and regulatory reporting workflows is a plus.
- Familiarity with data governance, lineage, and audit requirements in financial systems.
- Exposure to big data ecosystems (Hadoop, Spark) and CI/CD pipelines for NiFi flows is advantageous.
Salary & Benefits:
The role offers a competitive salary range of INR 40 - 43 lacs annually. Additionally, benefits include:
- Health insurance coverage.
- Flexible working hours with the option to work remotely, preferably based in Pune.
- Opportunities for professional development and training.
Location:
Remote, with a preference for candidates based in Pune, India.
Working Hours:
This position will require alignment with UK hours.
Pay: ₹4,500,000.00 per year
Work Location: In person
