Apply for this Job
The Senior Data Engineer will oversee the department's data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis Responsibilities 8-10 years of data engineering experience developing large data pipelines. 5+ years of experience in data engineering within a production environment. Advanced knowledge of Python and Linux shell scripting Experience with SQL databases (e.g., Redshift, Postgres, MongoDB) Proficiency in building stream processing systems using Kafka Familiarity with Docker, Kubernetes, and cloud services. Design and implement scalable data solutions on Azure platform using Data Factory, Databricks, PySpark, Python, Hadoop and other related services. Develop and maintain CI/CD pipelines for automated deployment and testing of data solutions. Qualifications Bachelor's degree in Computer Science, Applied Mathematics, Engineering, or a related field. Must have excellent verbal and written communication. Must be able to problem solve and multi-task. Employees must be legally authorized to work in the United States. Verification of employment eligibility will be required at the time of hire. Visa sponsorship is not available for this position.
Date Posted: 14 April 2024
Apply for this Job