Tech Lead, Databricks & Modern Data Stack
Company: Creole Studios
Location: Ahmedabad, India
Reports to: Founder & CEO
Type: Full-time
About the role
Creole Studios is launching a dedicated Data & AI practice focused on the modern data stack, with Databricks as the anchor. The target market is US mid-market companies that need data platforms that actually work in production.
We are hiring our first Tech Lead for this practice. You will be one of the first engineers on the ground, lead a small pod of data engineers, and own technical delivery on our early client engagements.
This is a hands-on lead role. Roughly 60% deep technical work (architecture, code, reviews), 30% team leadership (mentoring, planning, quality), 10% client and pre-sales support.
If you are a strong senior data engineer ready for a lead role with real ownership, this is the seat.
For more information you can reach on : https://www.creolestudios.com
Requirements
What you will do
Technical delivery
-
Architect and build Databricks-based data platforms for US mid-market clients.
-
Design and implement medallion architectures, Delta Lake pipelines, Unity Catalog governance, and Workflows-based orchestration.
-
Write production PySpark and SQL. Yes, you will still be in the code.
-
Set engineering standards: code quality, testing, CI/CD, IaC, monitoring.
-
Own technical decisions on your projects. Architecture, tooling, trade-offs.
Team leadership
-
Lead a pod of 3 to 5 data engineers across 1 to 2 client engagements.
-
Run code reviews, design reviews, and weekly technical syncs.
-
Mentor mid and junior engineers. Help them get certified.
-
Interview and help hire engineers into your pod.
Client work
-
Be the technical point of contact for client engineering teams.
-
Run technical workshops, requirement-gathering sessions, and architecture reviews with client stakeholders.
-
Translate business requirements into technical solutions.
-
Support pre-sales: scoping calls, technical proposals, effort estimates. You will not own pre-sales, but you will be in the room.
Practice building
-
Contribute to internal IP: reusable accelerators, reference architectures, demo assets.
-
Help shape engineering standards and delivery playbooks for the practice.
-
Co-author technical blog posts and case studies.
What you bring
Must have
6 to 10 years in data engineering, with at least 3 years on Databricks or Spark at production scale.
-
Strong PySpark and SQL. You can write, debug, and optimize Spark jobs without help.
-
Databricks ecosystem fluency: Delta Lake, Unity Catalog, Workflows or DLT, MLflow basics. Databricks Certified Data Engineer Associate or Professional (or willing to get certified within 60 days of joining).
-
One cloud at strong level, ideally AWS or Azure. Comfortable with IAM, networking basics, and Terraform or equivalent IaC.
-
Modern data stack exposure beyond Databricks: Airflow, dbt, Fivetran, or similar.
-
Prior lead or senior engineer experience. You have led at least one team of 3+ engineers on a real project. You know how to run a code review, push back on bad design, and unblock a junior.
-
Solid English, written and spoken. You will be on calls with US clients regularly.
Strong bonus
-
Databricks Certified Data Engineer Professional or ML Associate.
-
Experience working with US clients in a services or consulting setting.
-
GenAI or LLM work on Databricks (Mosaic AI, vector search, RAG pipelines).
-
DevOps fluency: CI/CD pipelines, Docker, Kubernetes, observability tooling.
-
Open source contributions, technical writing, or conference talks.
What this role is not
-
A pure individual contributor seat. You will lead people.
-
A management-only role. You will still be in the codebase every week.
-
A 9-to-5 with a fixed scope. Early-practice work is variable. Some weeks are heavy delivery, some are pre-sales support, some are internal R&D.
Benefits
What you get
-
A leadership role in a brand new practice with room to grow into a Principal or Practice Lead position over 2 to 3 years.
-
Direct working relationship with the founder. Decisions get made quickly.
-
US client exposure from day one. Real platforms, real production scale.
-
Strong compensation with a performance-linked component.
-
Full sponsorship for Databricks certifications, cloud certifications, and relevant training.
-
A small, senior team to work with. No bureaucracy. No legacy projects.
How to apply
Send the following to [careers email]:
-
A resume or LinkedIn profile.
-
A short note (5 to 10 lines) on the most complex Databricks or Spark problem you have solved and how you approached it.
-
Optional: links to GitHub, technical writing, or conference talks.
We will respond to every serious application within 5 working days.
Creole Studios is a 12 year old bootstrapped software studio with offices in Ahmedabad and a US entity. We build custom software, AI products, and data platforms for founders and operators globally.
