Dataiku Platform Engineer
Experience: 5+ Years
Location: Remote
Job Type: Full-Time
Job Overview
We are looking for an experienced Dataiku Platform Engineer to design, develop, and support a Dataiku-based data processing platform for Independent Price Verification (IPV). The role involves modernizing legacy Access databases, Excel workbooks, and VBA processes into scalable, governed, auditable, and automated Dataiku pipelines.
Key Responsibilities
- Design and develop Dataiku DSS workflows, recipes, scenarios, and automation.
- Build scalable ETL/ELT pipelines for data ingestion, transformation, reconciliation, and business rules.
- Develop metadata-driven frameworks for source onboarding, validation, processing, and exception handling.
- Reverse engineer and migrate MS Access, Excel formulas, VBA, and macros into Dataiku-based solutions.
- Implement pricing, variance calculations, breach determination, reconciliation, and exposure analysis.
- Develop configurable business rules, approval workflows, thresholds, and valuation logic.
- Build Data Quality Firewall controls including completeness, validity, consistency, reconciliation, and outlier checks.
- Implement quarantine and exception-handling workflows.
- Ensure data lineage, traceability, auditability, and reproducibility of processing.
- Support SOX, security, governance, and audit requirements.
- Integrate Dataiku with PostgreSQL/Amazon RDS, Power BI, Power Automate, Murex, SOLARC, Position Manager, and Azure services.
- Collaborate with DevOps teams on Git, CI/CD, deployment automation, and environment management.
- Support SIT, UAT, reconciliation testing, parallel runs, production releases, and root-cause analysis.
Required Skills
- 5+ years of experience in Data Engineering / Data Platform Development.
- 3+ years of hands-on Dataiku DSS experience.
- Strong Python programming skills.
- Advanced SQL skills.
- Strong experience with ETL/ELT pipelines and transformation frameworks.
- Experience with PostgreSQL or relational databases.
- Knowledge of data quality, reconciliation, metadata, and data governance.
- Experience with Git and CI/CD.
- Experience working in regulated or audit-sensitive environments.
- Strong analytical and problem-solving skills.
Good to Have
- Experience in Commodity Trading, Energy, Risk, or Financial Services.
- Knowledge of pricing, valuation, market data, or risk platforms.
- Experience with Murex, Power Automate, Amazon RDS, or Azure AI services.
- Experience with SOX-compliant solutions.
- Knowledge of data lineage and enterprise data governance.
- Experience supporting enterprise-scale Dataiku environments.
- Dataiku or Azure/AWS certifications.
Key Technologies
Data & Analytics: Dataiku DSS, Python, SQL, PostgreSQL, Amazon RDS, ETL/ELT
Integration: REST APIs, Power Automate, Azure, Murex, SOLARC
DevOps: Git, CI/CD, deployment automation, version control
Governance: Data Quality, Data Lineage, SOX, Audit Controls, Security Governance
Why Join?
- Work on an enterprise-scale Dataiku data platform.
- Opportunity to modernize critical legacy data processes.
- Exposure to data engineering, governance, risk, pricing, and automation.
- Remote working environment with a technically challenging project.
Pay: ₹70,000.00 - ₹90,000.00 per month
Experience:
- Data Engineering: 5 years (Required)
- Dataiku DSS : 3 years (Required)
Work Location: Remote
