Minimum of 5 years of experience in AI/ML solution implementation (mandatory)
Minimum of 3 years of experience in Pyspark processing high volume data (mandatory)
Multi-Agent System Design & Orchestration
Full-stack AI Integration (Frontend to Backend)
Advanced Prompt Engineering
LLM Observability, Evaluation & Monitoring (LLMOps)
Proficient in Pyspark coding and concepts. Example: Lazy evaluation, window functions, spark architecture and performance finetuning (ex: data skew reduction (salting etc), joins (broadcast, merge sort joins ect)
SQL proficiency and query optimization
