Project Role : Data Engineer
Project Role Description : -Resource should have 5+ years of work exp. Strong data warhouse knowledge + Data Analytics in Banking Domain, along with hands on SQL+Python Skills + DQ - Develop, optimize, and maintain complex SQL queries - Good understanding on data, users and should be able to write python code to generate reports. - Build automated data pipelines using Python (Pandas, NumPy, SQLAlchemy, PySpark, etc.). - Integrate data from multiple sources (APIs, flat files, cloud storage, third-party systems). -Experience in Handling DWH & Cl
Must have skills : Python Frameworks
Good to have skills : Ab Initio
Minimum
2 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
In the role of Data Engineer, a typical day involves managing and enhancing data infrastructure to support business analytics and reporting needs. This includes developing and refining data pipelines, integrating diverse data sources, and ensuring data quality and accessibility. The role requires close collaboration with various teams to understand data requirements and deliver reliable data solutions that drive informed decision-making within the organization. Continuous monitoring and optimization of data workflows are essential to maintain efficiency and accuracy in data handling processes.
Roles & Responsibilities:
- Expected to perform independently and become an SME.
- Required active participation/contribution in team discussions.
- Contribute in providing solutions to work related problems.
- Collaborate with cross-functional teams to gather and analyze data requirements.
- Design and implement scalable data pipelines to support business intelligence and analytics.
- Monitor data workflows to ensure data integrity and troubleshoot any issues promptly.
- Document processes and maintain clear communication channels within the team.
- Support junior team members by sharing knowledge and assisting with technical challenges.
Professional & Technical Skills:
- Must To Have Skills: Proficiency in Python Frameworks, Ab Initio.
- Experience in developing and optimizing complex SQL queries for data extraction and transformation.
- Strong knowledge of data warehousing concepts and architecture.
- Hands-on experience with data integration from multiple sources including APIs, flat files, and cloud storage.
- Familiarity with building automated data pipelines using Python libraries such as Pandas, NumPy, SQLAlchemy, and PySpark.
- Ability to work with large datasets and ensure data quality through effective data validation and cleansing techniques.
Additional Information:
- The candidate should have minimum 2 years of experience in Python Frameworks.
- This position is based at our Pune office.
- A 15 years full time education is required.
