Databricks Engineer

Role name:
Location:
Type Databricks Engineer
Columbus, OH
Contract Role Description: Strong experience in DatabricksExpertise implementing batch and real time data process solutions using Azure Data Lake storage, Azure Data Factor and Databricks.Experience in built ETL pipelines for ingesting, transforming and loading data from multiple sources into Cloud data ware housesProficient in Docker for containerization, utilizing REST API in Python for seamless system integration, and applying containerization concepts to improve deployment efficiency and scalability. Experience in data extraction, data acquisition, transformation, data manipulation, performance tuning and data analysis.Experience in Python libraries to build efficient data processing workflows and streamline ETL operations across large data sets and similar distributed systems.Expertise in automating data quality checks, reducing data errors by 40% and ensuring more reliable reporting and analytics with data marts. Expertise in data orchestration and automation tools such as Apache Airflow, Python, and PySpark, supporting end- to-end ETL workflows. Experience in deployment activities. Competencies: Digital : Databricks

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.