What awaits you/ Job Profile
AWS Python Expert - Cloud Data Hub
Description:
- We are seeking a highly skilled Backend Developer to join the Cloud Data Hub (CDH) Team, working closely with teams in Munich and BMW Tech Works India. The ideal candidate is a backend development expert with proficiency in Python, AWS, Kafka, Terraform, and Git, and a passion for building scalable and efficient systems. This role will involve designing, developing, and maintaining backend solutions for the CDH platform, contributing to BMW//'s transformation into a fully data-driven organization.
Responsibilities:
- Design, develop and maintain backend systems for the CDH platform, ensuring robust, scalable, and efficient solutions.
- Build and enhance serverless architectures and REST APIs using Python and AWS services.
- Implement and manage Kafka data streaming pipelines for real-time data processing and metadata orchestration.
- Develop and deploy infrastructure using Terraform for infrastructure-as-code automation on AWS.
- Utilize Git for version control and collaborate with the team on code reviews and CI/CD pipelines.
- Apply Test-Driven Development (TDD) principles to ensure code reliability, maintainability, and high-quality deliverables.
- Ensure the backend systems comply with BMW’s security standards, performance metrics, and scalability requirements.
- Proactively identify, debug, and resolve performance bottlenecks and system issues.
- Contribute to technical documentation and knowledge sharing to ensure project continuity and team alignment.
What should you bring along
Requirements:
- Expert-level proficiency in backend development with Python.
- Strong experience with AWS cloud services, including Lambda, S3, DynamoDB, API Gateway, and other serverless offerings.
- Hands-on expertise with Kafka for building and managing data streaming solutions.
- Advanced skills in Terraform for infrastructure automation and management.
- Proficient in writing optimized SQL queries and working with relational databases.
- In-depth knowledge of Git for version control and experience with CI/CD pipelines.
- Experience in building distributed systems and handling large-scale, real-time data processing workloads.
- Strong understanding of system design, scalability, and security best practices.
- Excellent debugging and problem-solving skills, with a detail-oriented mindset.
- Good communication and interpersonal skills to collaborate effectively with cross-functional teams.
- Familiarity with data engineering concepts like data modeling, schema evolution, and partitioning strategies for large-scale storage.
- Proven ability to build shared tools, libraries, or frameworks that enable other engineers or customers to work more effectively.
- Commitment to writing well-tested, maintainable code, with experience in unit and integration testing.
- Familiarity with version control (Git) and CI/CD best practices.
- Strong communication skills and a collaborative, customer-focused mindset.
Must have technical skills
- Python, ideally in a cloud-native, serverless context
- AWS services Glue, S3, Lambda, IAM, Step Functions
- REST APIs
- Data engineering concepts like data modeling, schema evolution, and partitioning strategies
- GitHub
- Experience in Snowflake
- Experience working with Docker and containerized environments.
- Familiarity with agile frameworks and participation in Scrum ceremonies.
- Knowledge of monitoring and observability tools like CloudWatch, Prometheus, or Grafana.
- Certification in AWS Solutions Architecture or related AWS certifications.
Good to have technical skills
- Experience integrating with Snowflake, Azure, or SAP systems.
- Familiarity with Glue Data Catalog, AWS Secrets Manager, or other security best practices.
- Experience building data quality monitoring dashboards or developer tooling for pipeline management.
- Experience with Infrastructure as Code tools such as Terraform for managing AWS resources.
- React, Vue, or Angular
