Job Description Job Description
Job Overview We are seeking a Data Engineer to join our team and play a crucial role in building, optimizing, and maintaining our data infrastructure. The ideal candidate is highly skilled in SQL, data warehousing, ETL processes, and cloud-based data platforms, with hands-on experience using third party connectors or developing APIs for data ingestion. This role requires a strong technical background in Azure SQL and a passion for working with structured and unstructured data.
As a Data Engineer, you will work closely with software engineers, analysts, and business stakeholders to ingest, transform, and validate our data across multiple systems. You will also explore Microsoft Fabric to assess its feasibility as our future data storage and integration platform.
Key Responsibilities - Data Pipeline Development: Design, develop, and maintain ETL/ELT pipelines for data ingestion from various sources (APIs, databases, spreadsheets, etc.).
- Database Management: Manage Azure SQL databases and Azure Data Factory, ensuring data consistency, reliability, and security.
- API Development: Create APIs and integrations for seamless data ingestion, retrieval, and transformation.
- Data Validation & Governance: Ensure data integrity and accuracy at both the source level and data warehouse level by implementing validation mechanisms.
- Cloud Infrastructure: Deploy and manage data storage solutions in Azure (e.g., Azure Blob Storage, Azure Synapse, Data Lake).
- Optimization & Performance: Optimize SQL queries, database structures, and data models to improve query performance and scalability.
- Automation & Tooling: Develop scripts and tools to automate data workflows and reduce manual intervention in data processing.
- Data Exploration & Migration: Evaluate Microsoft Fabric and other data platforms to determine feasibility for centralizing company data.
- Data Visualization (as needed): Support internal teams with basic reporting and dashboard creation using Power BI or similar tools, as time allows.
- Cross-Functional Collaboration: Work with software engineers, analysts, and business stakeholders to understand data needs and ensure seamless integration.
Required Qualifications & Skills - 3 - 5 years of experience
- Proficiency in SQL (writing complex queries, indexing, optimization).
- Experience with Azure SQL, Azure Data Factory, and Azure Synapse Analytics (or equivalent AWS/GCP data solutions).
- Strong understanding of ETL/ELT processes and data pipeline development.
- Experience with data ingestion APIs and working with structured/unstructured data.
- Familiarity with cloud-based storage (Azure Blob Storage, AWS S3, etc.).
- Experience with data validation techniques at both source and warehouse levels.
- Strong problem-solving skills and ability to optimize database performance.
- Ability to work with large datasets and troubleshoot data-related issues efficiently.
- Attention to detail and data accuracy in all aspects of work.
- Bachelor's degree in a related field or similar training/certifications
Preferred Qualifications - Familiarity with Microsoft Fabric for data integration and storage consolidation.
- Experience with data cataloging and metadata management.
- Hands-on experience in data modeling and schema design.
- Working knowledge of NoSQL databases (CosmosDB, MongoDB, etc.).
- Understanding of Master Data Management (MDM) and data governance principles.
- Exposure to NetSuite, particularly for reporting and item management.
- Experience working with POS and eCommerce systems (item catalog management).
- Basic data visualization skills (Power BI, Tableau, Excel) to support reporting when needed.
- Understanding of machine learning pipelines or AI-driven analytics.
Company Description
At Garrett Popcorn Shops, we've maintained our dedication to fresh, delicious Popcorn since we first opened at 10 West Madison Street in Chicago. We continue to use only the highest quality ingredients from local producers as we handcraft our gourmet Popcorn in old-fashioned copper kettles. We strive to deliver the same Popcorn today that customers first talked about in 1949.
Company Description At Garrett Popcorn Shops, we've maintained our dedication to fresh, delicious Popcorn since we first opened at 10 West Madison Street in Chicago. We continue to use only the highest quality ingredients from local producers as we handcraft our gourmet Popcorn in old-fashioned copper kettles. We strive to deliver the same Popcorn today that customers first talked about in 1949.