"Job Title: Senior Data Engineer – Core Team (Onshore)
Program: Symphony
Client: The Coca-Cola Company (TCCC)
Engagement Type: Contract
Model: Core Team
Location: Remote
Start Date: ASAP
Duration: Ongoing (Quarterly renewal)
Day to Day Job Duties:
- Migrate Spark Job Definitions from Synapse to Fabric (32)
Design, develop, and maintain data pipelines using Scala and SQL on Apache Spark.
- Monitor and support Phase 1 pipelines post go-live.
- Investigate and remediate pipeline failures, data quality issues, and performance bottlenecks.
- Lead refactoring and cleanup of existing Phase 1 code.
- Optimize existing solutions for performance and scalability.
- Build and contribute to reusable patterns and automation frameworks.
- Work within TCCC’s metadata-driven architecture.
- Ensure pipelines are used strictly for scheduling — ETL logic must remain in code.
- Manage code using GitHub version control.
- Contribute to discovery sessions to derive requirements directly from data.
Basic Qualifications:
- 8–10 years of hands-on data engineering experience.
- Strong understanding of Apache Spark and its core concepts.
- Proficiency in Scala and/or Java — code-first approach required.
- Advanced SQL skills.
- Experience with Azure Synapse.
- Working knowledge of GitHub for source control.
- Experience with data warehousing and large-scale data integration.
Travel: Remote
Degree: Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent work experience.
Nice to Have:
- Experience with Microsoft Fabric.
- Background in marketing data or consumer goods analytics.
- Familiarity with metadata-driven architectures.
Non-Negotiables:
- Must be a hands-on builder.
- Must be available to mobilize immediately.
"