Mandatory Skills & Experience:
❖ Experience: 5-8 years of experience in data engineering, DevOps, or a related technical field.
❖ Snowflake Expertise: 3+ years of hands-on experience with Snowflake's core functionalities, including designing
database schemas, efficiently loading data (using features like Snowpipe or the COPY into command), optimizing
query performance, and managing user roles and access within Snowflake.
❖ Python: Strong Python skills for scripting migration processes, custom ETL, and API interactions with Snowflake.
❖ Programming & Scripting: Strong programming skills in Python and Linux Bash for automation and data
workflows.
❖ Framework Proficiency: Hands-on experience with Luigi for orchestrating complex data workflows.
❖ Data Processing & Storage: Expertise in Hadoop ecosystem tools and managing SQL databases for data storage
and query optimization.
❖ AWS Cloud Services: In-depth knowledge of AWS EC2, S3, RDS, and EMR to deploy and manage data solutions.
❖ Monitoring & Alerting Tools: Familiarity with monitoring solutions for real-time tracking and troubleshooting of
data pipelines.
❖ Communication & Leadership: Proven ability to lead projects, communicate with stakeholders, and guide junior
team members.
Preferred Skills & Experience:
❖ Migration Tools & Strategies: Experience with specific data integration and ETL tools like Fivetran or Matillion,
which are often used for efficient data loading and transformation into Snowflake, would be a significant
advantage.
Data Engineer
❖ Custom scripting: For migration is also valuable.
❖ Data Governance in Snowflake: Understanding how to apply data governance, security protocols, and
compliance frameworks within Snowflake is highly desirable. This includes knowledge of features like dynamic
data masking, row-access policies, and external tokenization.
❖ CI/CD for Data Pipelines: Experience with CI/CD practices specifically for data pipelines, including automated
testing and deployment of Snowflake objects (e.g., using tools like dbt), would be a plus.
❖ Security Practices: Understanding of data security practices, data governance, and compliance for secure data
processing.
❖ Automation & CI/CD: Familiarity with CI/CD tools to support automation of deployment and testing.
❖ Big Data Technologies: Knowledge of big data processing tools like Spark, Hive, or related AWS services.
❖ Advanced Analytics: Background in analytics or data science to contribute to more data-driven decision-making.
❖ Cross-Functional Collaboration: Experience collaborating with non-technical teams on business goals and
technical solutions.
Pay: ₹75,000.00 - ₹110,000.00 per month
Work Location: Remote
