Hi ,
AWS Architect with Databricks
Location: Remote
Job Summary
We are seeking an experienced AWS Architect with Databricks to design, develop, and implement scalable cloud-based data platforms and analytics solutions. The ideal candidate will have deep expertise in AWS cloud architecture, Databricks, big data technologies, and modern data platform design.
________________________________________
Key Responsibilities
Cloud Architecture & Solution Design
- Design and implement scalable, secure, and highly available cloud solutions on AWS.
- Architect modern data platforms leveraging AWS services and Databricks.
- Define cloud architecture standards, best practices, and governance frameworks.
- Collaborate with business and technical stakeholders to translate business requirements into technical solutions.
- Conduct architecture reviews and provide recommendations for continuous improvement.
Databricks & Data Engineering
- Design and implement Databricks-based Lakehouse architectures.
- Develop and optimize ETL/ELT pipelines using Databricks, Apache Spark, Python, and SQL.
- Build and maintain large-scale data processing frameworks for batch and real-time analytics.
- Implement data integration solutions across multiple source systems.
- Optimize performance and scalability of data workloads.
AWS Platform Management
- Leverage AWS services such as S3, EC2, Lambda, Glue, EMR, Redshift, Athena, IAM, VPC, CloudWatch, and Kinesis.
- Design secure networking and access management strategies.
- Implement monitoring, logging, and alerting frameworks.
- Drive cloud cost optimization and resource utilization initiatives.
- Ensure high availability, disaster recovery, and business continuity planning.
Data Governance & Security
- Establish data governance, security, and compliance standards.
- Implement role-based access controls and data security best practices.
- Ensure compliance with organizational and regulatory requirements.
- Define data quality, lineage, and metadata management strategies.
Leadership & Stakeholder Management
- Provide technical leadership and architectural guidance to engineering and data teams.
- Mentor developers, data engineers, and cloud engineers.
- Collaborate with project managers, business stakeholders, and cross-functional teams.
- Lead architecture discussions, technical workshops, and solution reviews.
________________________________________
Required Skills & Qualifications
Technical Skills
- 10+ years of overall IT experience with strong expertise in cloud and data architecture.
- 5+ years of hands-on experience in AWS analytics solution architecture.
- Strong experience with Databricks, Apache Spark, Delta Lake, and Lakehouse architecture.
- Advanced proficiency in Python and SQL.
- Experience designing and implementing Data Lakes, Data Warehouses, and modern data platforms.
- Strong understanding of distributed data processing and analytics platforms.
- Experience with Infrastructure as Code (Terraform, CloudFormation, or equivalent).
- Experience with CI/CD pipelines and DevOps practices.
- Strong knowledge of cloud security, governance, networking, and compliance frameworks.
- Experience with performance tuning, monitoring, and troubleshooting cloud-based data platforms.
Preferred Skills
- Experience with real-time data processing technologies such as Kafka or AWS Kinesis.
- Exposure to machine learning and advanced analytics workloads on Databricks.
- Experience with containerization technologies such as Docker and Kubernetes.
- Knowledge of data cataloging, metadata management, and governance tools.
- Experience working in large-scale enterprise cloud environments.
- AWS and Databricks certifications are highly preferred.
________________________________________
Educational Qualification
- Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
- Ability to drive technical decisions and influence cross-functional teams.
Best regards,
Swapnil Thakur
Recruitment & Delivery Lead
iPeople Infosystems LLC
Contact No: +91 7972726448
Email ID: [email protected]
Visit us at www.ipeopleinfosystems.com
Pay: ₹3,000,000.00 - ₹3,500,000.00 per year
Work Location: Remote
