Senior Data Engineer
Description -
The Senior Data Engineer will design, build, and operate high-performance BI-centric solutions utilizing the comprehensive capabilities of the company's analytics platform. In this role, you will enable and support the intelligence strategy, support sustainable, effective, and efficient solutions, collaborate on data solutions, and support intellectual curiosity and continuous learning to meet individual and team development goals.
Applies advanced subject matter knowledge to solve complex business issues and is regarded as a subject matter expert. Frequently contributes to the development of new ideas and methods. Works on complex problems where analysis of situations or data requires an in-depth evaluation of multiple factors. Leads and/or provides expertise to functional project teams and may participate in cross-functional initiatives. Acts as an expert providing direction and guidance to process improvements and establishing policies. Frequently represents the organization to external customers/clients. Exercises significant independent judgment within broadly defined policies and practices to determine best method for accomplishing work and achieving objectives. May provide mentoring and guidance to lower level employees.
Job Type : Hybrid/Flexible work culture
Responsibilities
- Leads one or more project teams of other data engineers for all stages of design and development for complex, secure, and performant data solutions and models, including design, analysis, coding, testing, and integration of structured/unstructured data.
- Reviews and evaluates designs and project activities for compliance with architecture, security, and quality guidelines and standards; provides tangible feedback to improve product quality and mitigate failure risk.
- Drives innovation and integration of new technologies into projects and activities in the big data space.
- Create and maintain optimal data pipeline/ETL architecture.
- Collaborate with businesses, application and process owners, and product team members to define requirements and design solutions for the company’s big data and analytics solutions.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Databricks and other technologies.
- Perform data modeling and prepare data in databases for use in various analytics tools, and configure and develop data pipelines to move and optimize data assets.
- Provide necessary technical support through all phases of the solution life cycle.
- Independently handle complex issues with minimal supervision, while escalating only the most complex issues to appropriate staff
Knowledge & Skills
Must Have
- Databricks for data engineering, analytics, and machine learning workflows
- Python and SQL programming and advanced ETL pipelines
- Lakeflow and Spark-based big data processing and orchestration on Databricks
- GitHub, CI/CD, Databricks Asset Bundles, and modern software engineering practices applied to data engineering
- Strong analytical and problem-solving skills
Nice to Have
- BI and reporting tools (Tableau)
- Collaboration and Agile (Jira, Confluence, Scrum, Kanban)
- Experience with NoSQL and relational systems
- A current Databricks Certified Data Engineer certification
- Team Leadership and Data Ops skills
Experience Highlights
- Designing and deploying scalable data solutions on Databricks and cloud ecosystems
- Building and optimizing distributed data pipelines for complex, high-volume environments
- Implementing BI solutions and enabling data-driven decision-making
- Communicating architecture and design proposals effectively to senior stakeholders
- Working at a complex, high-stakes, startup-like environment
Scope & Impact
- Collaborates with peers, Data engineers, data scientists, and the project team.
- Typically interacts with high-level Individual Contributors, Managers, Directors, and Program Core Teams.
- Leads multiple projects requiring data engineering solutions development.
- Drives design innovation.
Prior Beneficial Experiences
- Experience and skills with application programming interface development.
- Applied experience in reporting tools.
- Applied experience with cloud platforms.
Education & Experience
- Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or equivalent.
- Typically 6-10 years’ experience.
#LI-POST
Job -
Data & Information Technology
Schedule -
Full time
Shift -
No shift premium (India)
Travel -
Relocation -
Equal Opportunity Employer (EEO) -
HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).
Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.
For more information, review HP’s EEO Policy or read about your rights as an applicant under the law here: “ Know Your Rights: Workplace Discrimination is Illegal "
