Title: Devops Engineer Location: Montvale, NJ Type : ContractJob Description: - experience with DataOps & CI/CD practices to enable automated building, testing, and deployment of data products and applications?
- 2+ years of experience in integrating with heterogenous sources using linked services.? 2+ years?
- experience enabling data governance capabilities and configuration in data engineering lifecycle (data privacy, data security & compliance, and data quality)?
- 2+ years integrating and nuances around maintaining GitHub and GitHub actions.? 2+ recent years in ADF creating pipelines with several activities?
- 2+ recent years of experience developing PySpark notebooks in Azure databricks cluster? 1+ years of hardcore experience with SparkSQL?
- 1+ years of relevant configuration experience in unity catalog integration and use?
- Strong experience with configuration and administration of Azure data platforms (Azure Data Factory, Azure Databricks, etc)?
- Support the strategy, planning, and implementation of data processing design and provide sizing and configuration assistance?
- Provide code review and facilitate code management for engineering team to ensure best practices and performance standards?
- 4 years in SDLC agile and using CI/ CD pipeline using Github actions.? 1+ years in deployment and post deployment activities in production.?
- 1+ year helping with standing the infrastructure stack and linked services with various sources.?
- Up to 1 year of Vectorization using OpenAI's embedding scheme and storing data in vector database? Collibra/ purview experience is a big plus.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.