Job Description
A client is searching for a Databricks Data Engineer to join their team. This will be a technical resource with hands-on data engineering experience who can help with: 1) Development of Data Engineering pipelines using Python notebooks and SQL (PySpark and Spark SQL), 2) Experience with Databricks Pipeline Orchestration in Databricks, 3) Experience with Unity Catalog, 4) Experience with automated testing in Databricks. This candidate will need to have 3+ years of experience total within data engineering and solutions architecture, with 2 years specifically working with Databricks products.
Expected Pay: $50-65/hr
Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to . The EEOC "Know Your Rights" Poster is available here .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: .
Skills and Requirements
- 3+ years of experience within data engineering and ETL processes
- Experience engineering pipelines using Python notebooks and SQL
- Experience loading star schema into data warehouses - Pyspark
- Unity Catalog
- GIT Integration
- Data Quality using Lakehouse Monitoring null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to .