Job Overview
We are looking for a skilled and experienced Data Engineer to design, build, optimize, and maintain scalable data pipelines and cloud-based data platforms. The ideal candidate should have strong expertise in Oracle and AWS data engineering technologies, along with hands-on experience in ETL development, migration projects, and DataOps practices.
The role involves working closely with data architects, application teams, and business stakeholders to support data integration, transformation, validation, and operational excellence initiatives.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines.
- Perform data migration and validation activities across cloud and on-prem environments.
- Develop and optimize data workflows using Oracle and AWS services.
- Build and maintain data integration processes using Oracle Data Integrator (ODI) and AWS Glue (PySpark).
- Manage and optimize data storage and processing using Amazon Redshift, Amazon S3, and Lake Formation.
- Monitor and troubleshoot data pipeline performance and operational issues.
- Implement DataOps best practices including CI/CD, automated deployments, testing, and monitoring.
- Create operational run-books, documentation, and support procedures.
- Collaborate with cross-functional teams for architecture reviews, deployment planning, and production support.
- Conduct performance testing and tuning for data processing workloads.
Required Skills
- Strong experience with Oracle Exadata environments.
- Hands-on expertise in Oracle Data Integrator (ODI).
- Experience with AWS Glue using PySpark.
- Strong knowledge of Amazon Redshift, Amazon S3, and AWS Lake Formation.
- Experience in ETL development and large-scale data migration projects.
- Good understanding of SQL, performance tuning, and data validation techniques.
- Experience with cloud-native data pipeline operations and troubleshooting.
Additional Skills
- Experience with DataOps practices and automation frameworks.
- CI/CD implementation for data pipelines.
- Infrastructure-as-Code experience using Terraform.
- Automated testing and deployment automation experience.
- Monitoring and operational management of data workflows.
Nice-to-Have Skills
- Experience with CDC and replication tools.
- Knowledge of AWS EventBridge, MWAA (Managed Workflows for Apache Airflow), and CloudWatch.
- Familiarity with data quality and governance frameworks.
Preferred Candidate Profile
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
- Ability to work independently in a fast-paced environment.
- Experience working in offshore delivery models is preferred.
Pay: ₹1,500,000.00 - ₹3,000,000.00 per year
Benefits:
- Internet reimbursement
- Provident Fund
- Work from home
Work Location: Remote
