Senior Data Engineer

Instinctools -
India

Apply Now

Job details

Qualifications

CI/CD
Data modeling
Azure
Computer Science
Big data
Spark
Git
English
Master's degree
SQL
Bachelor's degree
Machine learning
Continuous integration
Unity
GitHub
ETL
AI
Communication skills
Python
Analytics

Full job description

instinctools is a software development company that provides custom software solutions for businesses of all sizes. Our team works closely with clients to understand their specific needs and provide personalized solutions that meet their business requirements.
instinctools is looking for a Senior Data Engineer for one of our clients.

Our Client is one of the TOP-5 global management consulting firms considered to be among the most prestigious ones in the world. Hundreds of customers from Fortune-500, including the largest global financial institutions, the world’s top media companies, technology companies and federal government agencies rely on our Client’s proven platform and services.

Project is a dynamic solution empowering companies to optimize promotional activities for maximum impact. It collects and validates data, analyzes promotion effectiveness, plans calendars, and integrates seamlessly with existing systems. The tool enhances vendor collaboration, negotiates better deals, and employs machine learning to optimize promotional plans, enabling companies to make informed decisions and maximize return on investment.

Stack on the project: Databricks, SQL, Spark, Python Delta Lake (Delta Live Tables, Unity Catalog, Delta Sharing) Airflow, Azure Data Factory CI/CD pipelines (Azure DevOps / GitHub Actions or equivalent) Cloud Platforms (Azure preferred) BI and analytics frameworks (DBT)

Project duration: 12 months (with possible extension)

Location: Noida (office)

Tasks:

Design, build, and optimize scalable and reusable data pipelines on Databricks, SQL, and Spark
Orchestrate automated ETL workflows using Airflow, ADF, and CI/CD pipelines
Implement and manage scalable data processing systemsensuring performance, reliability, and cost-effectiveness
Ensure data quality, consistency, and compliance with governance/security standards
Collaborate with stakeholders to clarify requirements and translate them into technical solutions
Continuously evaluate and implement new tools/technologies to improve pipeline automation, monitoring, and efficiency

Our expectations of the ideal candidate:

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field
6+ years of experience in Data Engineering with strong big data expertise
Deep expertise in Databricks, Spark, and SQL (including Spark SQL)
Strong data modeling and ETL experience with large-scale datasets
Hands-on experience orchestrating data pipelines with Airflow and CI/CD
Proven experience with Delta Live Tables, Unity Catalog, Delta Sharing, and SQL
Warehouse (server & serverless)
Proficiency with Python for data engineering workflows
Familiarity with analytics engineering and DBT
Experience with data governance, compliance, and security in a cloud environment
Strong problem-solving ability, requirement clarification, and communication skills
Experience adopting software engineering best practices (testing, modularization, refactoring, automation)
Ability to optimize data systems for performance and cost efficiency in cloud environments
Exposure to AI/ML frameworks for development efficiency
Demonstrated ability to lead projects independently and mentor junior engineers

Soft Skills:

Strong self-management: ability to work independently and meet deadlines
Proactive and ownership-driven mindset
Effective and clear communication, including in distributed teams
Collaborative, open to feedback, and focused on shared goals
Strong problem-solving skills, especially in ambiguous contexts
High attention to detail and code quality
Adaptability to shifting priorities and new technologies

English: Upper-Intermediate or higher

Working time zone: IST+EU overlap

We offer:

flexible working time (from Indian location)
professional and ambitious team
learning opportunities, seminars and conferences and time for exploring new technologies
full remote work
co-funding for language courses (English)

Important Notice Regarding Your Personal Data Security

At *instinctools, we take the security of your personal data very seriously. Please be informed that all official communication, offers, and correspondence from *instinctools are conducted only through our verified company resources, including:
Official Email Domain: @instinctools.com
Company Website: https://www.instinctools.com
Important Reminder:

instinctools will NEVER ask for sensitive personal or financial information, including:

– Bank account details
– Credit/debit card numbers
– Passwords or PINs
If you receive any suspicious requests claiming to be from *instinctools via unofficial channels (e.g., personal emails, social media DMs, or phone calls), please:
– Do not respond or share any information.
– Report it immediately to [email protected] or your official contact.
Your trust and security are our top priorities. For any questions, always verify through our official channels.

Thank you for your attention and cooperation.

Apply Now

Our expectations of the ideal candidate:

We offer:

Jobseeker tools

Employer Tools

Browse

Stay Connected