Required Skills:
- ETL Development
-
AWS Data Services
-
PySpark
-
Python
-
SQL & Cloud DWH
-
Terraform
-
AWS Networking & IAM
-
CI/CD & Version Control
Nice to Have:
- Data Lake & Governance
-
CloudWatch
RESPONSIBILITIES: This is a strong technology and solution delivery role, accountable for the successful design, development, and delivery of ETL solutions on the corporate Data Platform. • Responsible for the delivery of the development activities he/she owns including ETL standards, patterns and best practices. • Work with team to ensure standards and patterns are followed. • Determines organizational strategies for data integrity validation processes. • Establishes policies and best practices for optimizing ETL data throughput/accessibility • Identifies opportunities for new initiatives; makes recommendations on the increasing scalability and robustness of ETL platforms and solutions. • Partner with the Data modelers to drive improvements and enhancements to the current data landscape and future strategy. • Remain current on new ETL techniques and methodologies and communicate trends and opportunities to management and other developers as needed. • Identify opportunities for uses of those technologies to enhance current or anticipated information systems and business goals • Evaluates existing applications that could address client requirements and makes recommendations from complex projects. • Identifies opportunities for solution sharing and reuse. • Assists in the development of ETL-related Service Level Agreements. • Communicates risks and ensures understanding of these risks. QUALIFICATIONS:B.E or B TECH or MASTERS IN COMPUTER SCIENCE, ELECTRONICS, RELEVANT TECHNICAL CERTIFICATION Experience(in years) : 5 Skill Set Required Technology Skills and Project Experience: - 5 years of experience in ETL design, development and business system designs. - Good understanding of AWS networking concepts: VPC, subnets, routing, NAT gateways, security groups. - Proficiency in IAM concepts: roles, policies, assume-role, and cross-account access. - Hands-on experience in AWS services including but not limited to: S3, KMS, Lambda, Glue (or Spark), SQS, EventBridge. - Hand on experience in writing clean, modular, testable, and maintainable code using functional or OOP principles. - Good experience in at least one programming language such as Python, Scala, Java etc. - Willingness to learn Python/PySpark if not already experienced. - Good understanding of Spark architecture, execution plans, and performance tuning. - Strong SQL skills and experience with Redshift and/or Athena, or any other distributed computer engines. - Experience in writing and maintaining Terraform scripts. - Familiarity with Git, GitHub workflows, and CI/CD tools like Jenkins. - Exposure to data lake architectures and data governance practices. - Familiarity with monitoring and logging tools (e.g., CloudWatch). Business / Soft Skills: - Must have solid presentation, communication (on complex technical solutions) and interpersonal skills. - Ability to work effectively with globally dispersed stakeholders from business. - Ability to manage multiple priorities in a fast-paced environment. - A data-driven mindset, ability to clearly communicate complex business problems and technical solutions. - Ability to manage and make decisions about competing priorities and resources. - Ability to delegate where appropriate - Must be a strong team player
