Engineering College Chennai Tamil Nadu Databricks solution Jobs – 227 Open Jobs Today

Databricks Engineer
EXL Service —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- Master's degree
2d
Senior Databricks Engineer
EXL Service —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- Master's degree
7d
AI / ML Engineer
Accenture —Chennai, Tamil Nadu
- Full-time
- Azure
- Master's degree
- SQL
Data Engineer - Snowflake
Vega IntelliSoft Private Limited —Chennai, Tamil Nadu
- ₹18,00,000 - ₹23,00,000 an hour
- Oracle
- Databases
- SQL
Quick apply
Associate-Application Development-Backend Development
EXL Service —Chennai, Tamil Nadu
- Full-time
- Azure
- Master's degree
- Databases
Senior Data Engineer
Psiog Digital —Perungudi, Chennai, Tamil Nadu
- ₹8,00,000 - ₹10,00,000 a year
- Full-time
- Azure
- DevOps
- Databases
- Flexible schedule
- Food provided
Quick apply
AI/ML Engineer
Hitachi Rail —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- English
14d
Java Fullstack Developer
CRUX —Chennai, Tamil Nadu
- Full-time
- Azure
- Java
- APIs
Quick apply
Lead Data Engineer - MNC
Unidos Technology —Chennai, Tamil Nadu
- ₹18,00,000 - ₹20,00,000 a year
- Management
- English
- SQL
Quick apply
4d
Data Analyst – Data Office
Optimum Solutions —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- Master's degree
Databricks Developer
Kumaran Systems —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- DevOps
Internal Technical Content Specialist, CS Global Office
Denodo —Chennai, Tamil Nadu
- Computer Science
- B.Sc
- Windows
Technical Project Manager
SquareShift Technologies —Chennai, Tamil Nadu
- Full-time
- PMP
- English
- Project management
AI/ML Engineer
Hitachi —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- English
Senior PowerBI Developer - DOMO AI + SQL
UPS —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- SQL
Custom Software Engineer
Accenture —Chennai, Tamil Nadu
- Full-time
- Azure
- Software troubleshooting
- Software development
Senior Analyst-Data Quality Solution
AstraZeneca —Chennai, Tamil Nadu
- Full-time
- Azure
- Windows
- SQL
2d
Senior Software Engineer- Azure Data Developer
CGI —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- DevOps
Quick apply
Data Scientist
UPS —Chennai, Tamil Nadu
- Full-time
- Windows
- Java
- Master's degree
Data Engineer
Munyongo —Chennai, Tamil Nadu
- Online application
- Hybrid work
- Databases
- SQL
- AWS

I want to receive the latest job alerts for databricks solution in engineering college chennai tamil nadu

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

databricks solution jobs near engineering college chennai tamil nadu

Software Engineer jobs in Chennai, Tamil Nadu

Data Analyst jobs in Chennai, Tamil Nadu

Content Specialist jobs in Chennai, Tamil Nadu

Ai Ml Engineer jobs in Chennai, Tamil Nadu

Technical Project Manager jobs in Chennai, Tamil Nadu

Data Engineer jobs in Chennai, Tamil Nadu

Senior Software Engineer jobs in Chennai, Tamil Nadu

Senior SQL Developer jobs in Chennai, Tamil Nadu

Senior Quality Analyst jobs in Chennai, Tamil Nadu

Full Stack Developer jobs in Chennai, Tamil Nadu

Developer jobs in Chennai, Tamil Nadu

Software Engineer jobs in Chandrasekharpur, Bhubaneswar, Orissa

Software Engineer jobs in Zirakpur, Punjab

Software Engineer jobs in Raipur, Chhattisgarh

Software Trainee jobs in Kochi, Kerala

Electrical Design Engineer jobs in Noida, Uttar Pradesh

Software Engineer jobs in Warangal, Telangana

Assistant Professor, Mechanical Engineer jobs in Chandigarh, Chandigarh

Data Analysis jobs in Jamshedpur, Jharkhand

Data Entry,form Filling Work From Home jobs in Tamil Nadu

Databricks Engineer

EXL Service -
Chennai, Tamil Nadu

Apply Now

Job details

Full-time
2 days ago

Qualifications

CI/CD
Azure
Law
Computer Science
Big data
Spark
Regulatory reporting
Git
Master's degree
SQL
AWS
Bachelor's degree
Distributed systems
Terraform
Continuous integration
Unity
GitHub
S3
Fraud prevention and detection
Kafka
AI
GitLab
Information Technology

Full job description

Job Description: We are looking for a skilled and passionate Databricks Engineer to design, build, and optimize enterprise-scale data lakehouse solutions on the Databricks platform. The successful candidate will be responsible for creating Databricks pipeline delivering Financial Crime platforms covering Anti-Money Laundering (AML), Know Your Customer (KYC), Customer Risk Assessment (CRA), Sanctions Screening, Transaction Monitoring, Fraud Detection, and Regulatory Reporting

Responsibilities: Databricks Platform Engineering

Design, build, and maintain Databricks workspaces, clusters, and compute pools across dev/test/prod environments.
Configure and manage Databricks Unity Catalog for data governance, access control, fine-grained permissions, and data lineage.
Optimize cluster configurations — instance types, auto-scaling policies, spot/preemptible nodes — for cost and performance.
Implement workspace-level best practices: folder structures, access controls, secret management (Databricks Secrets / Azure Key Vault / AWS Secrets Manager).

Delta Lake & Lakehouse Architecture

Design and implement Delta Lake tables with appropriate partitioning, Z-ordering, and file compaction (OPTIMIZE / VACUUM).
Build Medallion Architecture (Bronze / Silver / Gold) layers for structured data lake organization.
Implement Delta Live Tables (DLT) pipelines for declarative, reliable ETL/ELT with built-in data quality expectations.
Manage schema evolution, table versioning, time travel, and Change Data Feed (CDF) for incremental processing.

Data Pipeline Development (PySpark / SQL)

Develop scalable batch and streaming data pipelines using PySpark, Spark SQL, and Delta Lake.
Build structured streaming pipelines for real-time ingestion from Kafka, Event Hubs, and Kinesis into Delta tables.
Write optimized PySpark transformations leveraging broadcast joins, adaptive query execution (AQE), and dynamic partition pruning.
Create reusable transformation libraries, utility frameworks, and pipeline templates for team productivity.

MLflow & AI/ML Workloads

Set up and manage MLflow tracking servers, experiment registries, and model lifecycle management on Databricks.
Support data scientists and ML engineers in deploying model training and inference workloads on Databricks clusters and GPU instances.
Build feature engineering pipelines using Databricks Feature Store for reusable, versioned ML features.
Enable GenAI workloads — LLM fine-tuning, RAG pipeline development, and vector search (Databricks Vector Search / Mosaic AI).

Cloud Integration & DevOps

Integrate Databricks with cloud-native services: Azure Data Lake Storage (ADLS).
Build and maintain CI/CD pipelines for Databricks notebooks and jobs using Azure DevOps, GitHub Actions, or GitLab CI.
Implement Databricks Asset Bundles (DABs) or Terraform for infrastructure-as-code (IaC) deployment of Databricks resources.
Manage data ingestion using Auto Loader, COPY INTO, and partner integrations (Fivetran, dbt, Airbyte).

Governance, Security & Optimization

Implement row-level security, column masking, and dynamic data views using Unity Catalog policies.
Ensure data quality enforcement using Delta Live Tables expectations and Great Expectations integrations.
Conduct performance tuning — query plan analysis, caching strategies, Photon engine enablement.
Maintain data cataloging, metadata management, and data lineage tracking within Unity Catalog.
Document architecture decisions, runbooks, and operational guides for Databricks workloads.

Qualifications: Education

Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or related field.

Experience

4-6 years of total experience in data engineering or software engineering.
2+ years of dedicated hands-on experience with the Databricks platform in production environments.
Strong background in big data engineering, cloud data platforms, and distributed computing.

Apply Now

Refine Your Search

databricks solution jobs in engineering college chennai tamil nadu

Databricks Engineer

Senior Databricks Engineer

AI / ML Engineer

Data Engineer - Snowflake

Associate-Application Development-Backend Development

Senior Data Engineer

AI/ML Engineer

Java Fullstack Developer

Lead Data Engineer - MNC

Data Analyst – Data Office

Databricks Developer

Internal Technical Content Specialist, CS Global Office

Technical Project Manager

AI/ML Engineer

Senior PowerBI Developer - DOMO AI + SQL

Custom Software Engineer

Senior Analyst-Data Quality Solution

Senior Software Engineer- Azure Data Developer

Data Scientist

Data Engineer

I want to receive the latest job alerts for databricks solution in engineering college chennai tamil nadu

Related Searches

Explore jobs in more locations

Jobseeker tools

Employer Tools

Browse

Stay Connected