Full time salaried role for a Sr. Data Engineer with 5+ years of data management/engineering experience.
Client requirements:
- Work authorization status - US Citizen or GC holder
- Location: Minneapolis metro - onsite 5 days/week
- Bachelor's degree
KEY NON-TECHNICAL SKILLS: Collaboration, team work, accountability, career tenured minded, leadership and mentorship skills.
KEY TECHNICAL SKILLS: data modeling, data governance/cleansing experience, cloud solutions and Snowflake. Experience with one or more of the following is required: Java, Python, SQL, R, SAS.
THE ROLE: You will engineer and manage robust data pipelines that ensure seamless, secure, and efficient data integration and transformation across the enterprise. Collaborate with operational and business partners, help to execute solutions that align with the data strategy.
- Designs, develops, and maintains scalable and efficient data pipelines for collecting, processing, consuming, and storing datasets.
- Implement data management practices to ensure data quality, including data cleansing, normalization, and validation techniques.
- Develop and maintain data warehouses, data lakes, ensuring efficient storage and retrieval of data assets.
- Implement data security measures, to protect sensitive information and ensure compliance with industry standards and regulations.
- Monitor and audit data access and usage to detect and prevent unauthorized access.
- Integrates data from various sources, including databases, data warehouses, APIs, and external systems.
- Ensures data consistency and integrity during the integration process, performing data validation and cleaning as needed.
- Ensure the reliability and scalability of near real-time data pipelines.
- Optimize data pipelines and data processing workflows for performance, scalability, and efficiency.
- Monitors and tunes data systems, identifies and resolves performance bottlenecks, and implements caching and indexing strategies to enhance query performance.
- Transforms raw data into a usable format by applying data cleansing, aggregation, filtering, and enrichment techniques. Leverage advanced analytics to drive business insights.
- Establishes the governance of data and algorithms used for analysis, analytical applications, and automated decision making. Implements data quality checks and validations within data pipelines to ensure the accuracy, consistency, and completeness of data.
- Ability to collaborate within and across teams of different technical knowledge to support delivery and educate end users on data products. Collaborates with business analysts to optimize models and algorithms for data quality, security, and governance.
EXPERIENCE - Bachelor's degree in computer science, data science, software engineering, information systems, or related quantitative field
- 5+ years of work experience in data management disciplines, including data integration, modeling, governance, security, optimization and quality, or other areas directly relevant to data engineering responsibilities and tasks
- Expert knowledge in technologies such as Fivetran, Kafka, Airflow, and Spark to build scalable and efficient data pipelines.
- Ability to design, build, and deploy data solutions that capture, explore, transform, and utilize data to support AI, ML, and BI.
- Proficient in programming and data science languages such as Java and Python, SQL, R, SAS.
- Proficiency in the design and implementation of modern data architectures and concepts like cloud services (AWS, Azure) and modern data platforms like Snowflake.
- Strong knowledge of data modeling, data warehousing, ETL and ELT processes.
- Proficiency in dbt analytics code design and implementation is required.
- Strong understanding of data governance, data quality and data security best practices
The salary range for this type of role is approximately $125,000 - 140, 000. This range is an estimate and not a guarantee of compensation. The final salary will be determined by factors such as experience, market trends, and specific job assignments. Discover more about how ITR Group connects top talent with leading client opportunities.