Key Responsibilities

• Lead end-to-end Snowflake migration projects, including assessment, planning, implementation, testing, and optimization
• Design scalable Snowflake data architectures and data models
• Ensure seamless migration with complete data integrity and minimal business disruption
• Optimize Snowflake performance through clustering, partitioning, and query tuning
• Implement Snowflake best practices for security, governance, and scalability
• Design, build, and maintain scalable ETL/ELT pipelines using Python and DBT
• Develop and orchestrate complex workflows using Luigi
• Process and transform large-scale datasets, including clickstream, demographic, and business data
• Implement data validation, quality checks, and reliability frameworks
• Configure, deploy, and manage AWS services including EC2, S3, RDS, and EMR
• Develop secure, scalable, and cost-efficient cloud-based data solutions
• Support data ingestion, storage, transformation, and retrieval processes
• Monitor and optimize AWS infrastructure performance and availability
• Enhance and maintain existing data platforms and frameworks
• Identify opportunities for modernization and cloud migration
• Build monitoring frameworks, dashboards, and alerting mechanisms
• Troubleshoot data pipeline failures, infrastructure issues, and performance bottlenecks
• Conduct root-cause analysis and implement preventive measures
• Ensure high availability and reliability of data systems
• Create and maintain technical documentation, workflows, and operational runbooks
• Establish engineering standards and best practices
• Mentor junior engineers and provide technical guidance
• Drive knowledge-sharing initiatives across teams

Requirements

• 5–8 years of experience in Data Engineering, Data Platform Engineering, or related roles
• Proven experience leading large-scale data engineering and migration projects
• Minimum 3 years of hands-on Snowflake experience
• Strong knowledge of Snowflake database design, schema architecture, Snowpipe, COPY INTO, query optimization, security, roles, permissions, and data sharing
• Strong programming expertise in Python
• Advanced SQL development and query optimization skills
• Hands-on experience with DBT for data transformation and modeling
• Experience with Luigi workflow orchestration
• Linux shell scripting and automation experience
• Strong understanding of ETL/ELT concepts and implementation
• Experience with Hadoop ecosystem technologies
• Knowledge of large-scale data processing frameworks
• Strong understanding of data warehousing concepts and best practices
• Hands-on experience with Amazon EC2, S3, RDS, and EMR
• Experience implementing monitoring, logging, and alerting solutions
• Strong troubleshooting and production support capabilities
• Excellent communication and stakeholder management skills
• Strong leadership and mentoring abilities
• Ability to work independently in a remote environment
• UAN mandatory

Skills Required