Must have Linkedin - Experienced Senior Data Engineer (8-10 years)
- Proficient across the software development life cycle, adept at Data Warehousing, ETL Concepts, MS SQL, Azure Data Factory, Azure Data Lake Storage, Databricks, Amazon Web Services, PySpark, Spark SQL and Python.
- Develop, deploy, and manage scalable pipelines on Databricks, ensuring robust integration with Databricks Feature Store leveraging online tables for machine learning models.
- Experience of architecture, design and development on GCP /AWS/Azure Databricks platform using Lakehouse architecture and utilizing Databricks tools/utilities such as Delta Lake, Autoloader, Delta Live Tables, Unity Catalog, Orchestration, Analytics/Machine Learning, etc.
Key skills:
Data Modelling
Python , Pyspark
SQL and SQL Procedure
Databricks - This is the key. Proficiency in Databricks
ETL Data Pipeline