Chennai Tamil Nadu Lead pyspark developer Jobs – 13 Open Jobs Today

Lead Pyspark Developer
Luxoft —Chennai, Tamil Nadu
- English
- APIs
- AI
Senior Data Engineer (Databricks & PySpark)
DATAMAXIS —Chennai, Tamil Nadu
- Full-time
- Remote
- Azure
- Java
- SQL
Quick apply
Intermediate Azure Developer - .NET, .Net Core,
UPS —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- Salesforce
Senior Data Engineer-Chennai
OneMagnify —Chennai, Tamil Nadu
- Full-time
- Azure
- DevOps
- SQL
- Paid holidays
- Health insurance
6d
3876997-Assistant Vice President
EXL Service —Chennai, Tamil Nadu
- Full-time
- Azure
- Master's degree
- Databases
- Health insurance
Principal Data GENAI Platform Engineer - Senior Vice President
Citi —Chennai, Tamil Nadu
- Full-time
- Azure
- Master's degree
- AWS
9d
Senior Data Developer - Azure Databricks+cosmos DB + SQL + ETL+SSIS
UPS —Chennai, Tamil Nadu
- Full-time
- Azure
- Computer Science
- DevOps
3877033-Senior Executive
EXL Service —Chennai, Tamil Nadu
- Full-time
- Azure
- Master's degree
- Databases
- Health insurance
3876995-Senior Manager
EXL Service —Chennai, Tamil Nadu
- Full-time
- Azure
- Master's degree
- Databases
- Health insurance

I want to receive the latest job alerts for lead pyspark developer in chennai tamil nadu

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

lead pyspark developer jobs near chennai tamil nadu

Assistant Vice President jobs in Chennai, Tamil Nadu

Data Engineer jobs in Chennai, Tamil Nadu

Senior Vice President jobs in Chennai, Tamil Nadu

Senior SQL Developer jobs in Chennai, Tamil Nadu

Net Developer jobs in Chennai, Tamil Nadu

Assistant Professor, Yoga jobs in Chennai, Tamil Nadu

Assistant Vice President jobs in Fort, Mumbai, Maharashtra

Lecturer, Assistant Professor Commerce jobs in Assam

Assistant Vice President jobs in Bangalore City, Bengaluru, Karnataka

Assistant Vice President jobs in Gurgaon, Haryana

Assistant Vice President jobs in Ghaziabad, Uttar Pradesh

Assistant Restaurant Manager jobs in Mumbai, Maharashtra

Assistant Professor, Bca jobs in Kolkata, West Bengal

Healthcare Data Analyst jobs in Maharashtra

Data Engineer jobs in Gurgaon Kty., Gurugram, Haryana

Data Engineer jobs in Pimpri Chinchwad, Maharashtra

Environmental Engineer jobs in Kerala

Data Engineer jobs in Belgaum, Karnataka

Data Engineer jobs in Noida, Uttar Pradesh

Vice Principal In Kanpur, Schools jobs in Kanpur, Uttar Pradesh

Lead Pyspark Developer

Luxoft -
Chennai, Tamil Nadu

Apply Now

Job details

Qualifications

Jira
NumPy
Git
English
Pandas
PostgreSQL
REST
Django
APIs
Apache
Business requirements
AI
Python
Debugging

Full job description

Project description

Surveillance Enhancement Program (SEP) is a multi-year program (MYP) to build and enhance the surveillance platform to detect potential instances of market misconduct, market manipulation and market abuse. The Bank met its commitment to FCA (Financial Conduct Authority, FCA) to meet Market Abuse Regulation ("MAR") requirements for critical data sources in September 2017. Following that, subsequent projects were initiated to further enhance, expand and complement the current coverage of the automated surveillance platform. This project will focus on Alerts enhancements, Strategic data sourcing from FM order and trade lakes, UI / workflow enhancements to meet regulatory obligations (i.e. Market Abuse Regulation, Dodd Frank). This also includes Control Room & Suitability Monitoring related data, UI and scenario enhancements.

Responsibilities

Develop software applications based on business requirements

Maintain software applications and make enhancements according to project specifications

Participate in requirement analysis, design, development, testing, and implementation activities

Propose new techniques and technologies for software development.

Perform unit testing and user acceptance testing to evaluate application functionality

Ensure to complete the assigned development tasks within the deadlines

Work in compliance with coding standards and best practices

Provide assistance to Junior Developers when needed.

Perform code reviews and recommend improvements.

Review business requirements and recommend changes to develop reliable applications.

Develop coding documentation and other technical specifications for assigned projects.

Act as primary contact for development queries and concerns.

Analyze and resolve development issues accurately.

Skills

Must have

10+ years of experience in data intensive Pyspark development

Must have experience in leading a Development Team

Proven experience as a Core Python developer

Good understanding of Gen AI

Experience developing Classes, OOPS, exception handling, parallel processing

Strong knowledge of DB connectivity, data loading , transformation, calculation

Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations

Lambda Functions, Decorators

Vector operations on Pandas dataframes /series

Application of applymap, apply, map functions

Concurrency and error handling data pipeline batch of size [1-10 gb]

Ability to understand business requirements and translate them into technical requirements

Ability to design architecture of data pipeline for concurrent data processing

Familiar with creating/designing RESTful services and APIs

Familiar with application unit tests

Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services

Debugging application

Nice to have

Knowledge of web backend technology

Django, Python, PostgreSQL.

Apache Airflow

Atlassian Jira

Understanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a plus

Surveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a plus

Other

Languages

English: C2 Proficient

Seniority

Lead

Chennai, India

Req. VR-121229

Python

BCM Industry

12/06/2026

Req. VR-121229

Apply Now

Refine Your Search

lead pyspark developer jobs in chennai tamil nadu

Lead Pyspark Developer

Senior Data Engineer (Databricks & PySpark)

Intermediate Azure Developer - .NET, .Net Core,

Senior Data Engineer-Chennai

3876997-Assistant Vice President

Principal Data GENAI Platform Engineer - Senior Vice President

Senior Data Developer - Azure Databricks+cosmos DB + SQL + ETL+SSIS

3877033-Senior Executive

3876995-Senior Manager

I want to receive the latest job alerts for lead pyspark developer in chennai tamil nadu

Explore jobs in more locations

Project description

Responsibilities

Skills

Other

Jobseeker tools

Employer Tools

Browse

Stay Connected