Role: Data Engineer
Mandatory Skills: AWS EMR, Apache Spark, PostgreSQL, DynamoDB, Apache Iceberg
Good to Have Skills: Python and Spark Programming
Qualification: Graduate
Total Experience: 5+ Years
Relevant Experience: 3+ Years
Work Location: Trivandrum / Kochi / Remote
Expected Onboarding: Immediate
Shift: General shift with US overlapping hours
Open Positions: 1
Job Purpose:
We are seeking a highly skilled Senior Data Engineer (Contractor) to design, build, and optimize scalable data platforms and pipelines. This role will play a critical part in developing modern data lakehouse architecture on AWS, enabling advanced analytics and data-driven decision-making across the organization.
Key Responsibilities:
· Design, develop, and maintain analytical data models and metrics using modern, scalable data platform technologies.
· Architect and implement data lakehouse solutions leveraging AWS services.
· Build, optimize, and maintain robust data pipelines using PySpark, Python, and AWS Glue.
· Ensure high performance, reliability, and scalability of data systems.
· Collaborate closely with business stakeholders to translate requirements into data solutions.
· Partner with architecture and operations teams to enforce best practices, standards, and governance.
· Monitor and troubleshoot data workflows, ensuring data quality and system efficiency.
· Adhere to Information Security Management policies and procedures.
Technical Skills & Competencies:
· 5+ years of professional experience in software development with a focus on analytical platform development.
· 3+ years of hands-on experience with data platforms and big data ecosystems.
· Expertise in AWS EMR, Apache Spark, PostgreSQL, DynamoDB, and Apache Iceberg.
· Proficiency in Python and Spark programming.
· Experience with AWS Step Functions, Lambda, EventBridge, Aurora, and Redshift.
· Experience working in Agile development environments.
Preferred Qualifications:
· Amazon Kinesis
· Amazon Firehose
· Amazon SQS
· Amazon Bedrock
· Amazon SageMaker
· Real-time data streaming and event-driven architectures
· Machine learning data pipelines
Soft Skills & Competencies:
· Strong ability to learn and adapt to new technologies quickly
· Excellent problem-solving and analytical thinking skills
· Ability to work independently and collaboratively in a team environment
· Strong multitasking skills in a fast-paced environment
· Excellent verbal and written communication skills
Pay: ₹160,000.00 - ₹170,000.00 per month
Application Question(s):
- Will you be available immediately for contract role(6+ months)?
Education:
Experience:
- Data Engineer AWS: 6 years (Required)
Work Location: Remote