Role : DataBricks Technical Lead Location : Louisville ,Kentucky (Day 1 onsite)Num of Positions : 1 Required SKills :
Must Have/Mandatory Skills:
- Minimum 9+ years of experience in the IT/Technology and having atleast 3+ years of experience in Azure Databricks
- Hands on experience in development of Azure cloud DWH & datalakes using Azure technologies like Spark (Scala or Python), ADF, Azure Databricks, Terraform & CI/CD.
- Strong programming skills in Pyspark, Python, writing complex queries in Postgresql, T-SQL
- 6+ years of experience in coding complex U-SQL, Spark (Scala or Python). T-SQL, postgresql
- Should have experience in Azure Storages like ADLS Gen2, Azure Postgresql
- Design and develop automation to support continuous delivery and continuous integration process when it comes to cloud infrastructure.
- Work closely with the Development and Operations teams to build and maintain CI/CD pipelines to support automated deployment of infrastructure (DevOps) and Infrastructure as Code (IaC) using Terraform and Enterprise Github
- Understanding of Azure Database technologies (both IaaS and PaaS) and options to support the migration process. This will include and not limited to Azure database migration technologies and refactoring options.
- Build effective monitoring, logging and auditing of production systems to ensure compliance with mandated compliance policies (e.g., HIPAA).
- Must have experience in Azure Kubernetos.
Good to have:
- Event hub, Data streaming
- Data Encryption
- Knowledge of SQL Server, Oracle etc. other databases is a plus.
- Azure Certifications are plus