We are seeking a skilled Data Engineer to join our team, specializing in building and maintaining modern data pipelines using ETL/ELT methodologies. The ideal candidate will have extensive experience in transforming unstructured data into structured datasets, creating CI/CD automation, and ensuring high-quality, validated data for analytical purposes. Key Responsibilities Built and maintained scalable ELT pipelines using Databricks Developed robust data models with advanced SQL (CTEs, window functions, joins) Implemented CI/CD pipelines for dbt projects using Git Automated data validation using Python and Q-Test Managed version control, code reviews, and pull requests Migrated data across diverse sources (Excel, XML, JSON, SQL Server) Resolved production issues and ensured data reliability Collaborated with stakeholders to deliver data-driven solutions Created technical documentation and knowledge base artifacts Integrated Databricks APIs with React applications on AWS Implemented IAM security, CI/CD, and CloudWatch monitoring Optimized system performance for scalability and availability Configured end-to-end integration between Databricks APIs and React frontend applications on AWS, implementing CI/CD pipelines, IAM-based security, monitoring with CloudWatch, and optimized compute/storage setup for high availability and performance. ##LI-DNI We are seeking a skilled Data Engineer to join our team, specializing in building and maintaining modern data pipelines using ETL/ELT methodologies. The ideal candidate will have extensive experience in transforming unstructured data into structured datasets, creating CI/CD automation, and ensuring high-quality, validated data for analytical purposes. Key Responsibilities Built and maintained scalable ELT pipelines using Databricks Developed robust data models with advanced SQL (CTEs, window functions, joins) Implemented CI/CD pipelines for dbt projects using Git Automated data validation using Python and Q-Test Managed version control, code reviews, and pull requests Migrated data across diverse sources (Excel, XML, JSON, SQL Server) Resolved production issues and ensured data reliability Collaborated with stakeholders to deliver data-driven solutions Created technical documentation and knowledge base artifacts Integrated Databricks APIs with React applications on AWS Implemented IAM security, CI/CD, and CloudWatch monitoring Optimized system performance for scalability and availability Configured end-to-end integration between Databricks APIs and React frontend applications on AWS, implementing CI/CD pipelines, IAM-based security, monitoring with CloudWatch, and optimized compute/storage setup for high availability and performance.