Piper Companies is seeking a Data Engineer to cluster large datasets across various container and data platforms depending on external client needs. The Data Engineer will work hands-on with challenging data engineering, data management, and analytics projects.This job opens for applications on 1/14/2024. Applications for this job will be accepted for at least 30 days from the posting date.
Responsibilities of the Data Engineer include:
Achieve and maintain proficiency with cluster and framework sizing, installation, debugging, performance optimization, migration, security and automation
Collaborate with data scientists, analysts, business users, and IT teams to design, implement, and deploy data services and analytics.
Use Continuous Integration/Continuous Delivery (CI/CD) concepts to engineer a standardized data environment
Recommend and advise on optimal data models for data ingestion, integration, and visualization
Integrate data from a variety of data source types
Qualifications for the Data Engineer include:
6 years of experience with data engineering in a Microsoft technology environment
Experience with Microsoft: Databricks, Data Factory, Fabric, Dynamics 365, Power BI, Purview and Lakehouse or OneLake
3+ years cloud experience: Azure
Bachelors or Masters Degree in STEM field
Microsoft certifications are a bonus
Compensation for the Data Engineer include:
Contract: $85/hr W2
Salary: $165,000
Comprehensive benefits: Medical, Dental, Vision, 401K, PTO, Sick Leave if required by law, and Holidays