Senior Data Engineer

Chesterfield, Missouri

inSync Staffing
Job Expired - Click here to search for similar jobs
Backfill for someone who completed their contract, they are renewing as he couldn't problem solve.

Hiring a Senior Data Engineer

Must HAVE: Snowflake, DBT as a transformation tool, if they are a SQL expert they can likely get up to speed in DBT, must have worked with large data sets (RGA IS AT PETABYTES),

RGA uses Github and GIT as source control and they run agile.

This person will be creating new data pipelines using DBT to load data into snowflake

SOFT SKILLS MUST HAVE: this developer is embedded with multiple teams and will need to have a mindset of working through obstacles, and be a problem solver. They need to get to the underlying ask and build data pipelines.

RGA Effort: They have numerous transactional systems, they have been working on different workloads. they are moving the transactional data to AWS with SNOWFLAKE ON TOP, S3 on the backend. They have developed a robust governance model to access the data. Some of the framework is also built and they are ingesting the data into snowflake.

First 30 days: - come up to speed on technical environment, as well as start writing some data pipelines, and start to build relationships with the team.

Position Overview

Independently designs, develops, tests, implements, documents, and supports big data/ data fabric platforms, including big data cataloging, modeling, ingestion, streaming, processing, and storage technologies and processes. Applies a general understanding of the source systems, and leverages general knowledge of data warehouse and business intelligence technologies, as well as processes, to execute responsibilities. Must have effective communication and collaboration skills to ensure work output meets business needs.

Responsibilities

1
Creates and supports the process to ingest data from source systems and place it into the data fabric and analytics platforms

2
Performs big data pipeline design and testing, including data design, data architecture, catalog, and repository creation

3
Designs, develops, and maintains the data technologies and architectures

4
Works with business and IT stakeholders to optimize information by defining business requirements and populating the data fabric

5
Collaborate with business to develop models and transformations that meet advanced analytics needs

6
Recommends improvements and applies standards, processes, and procedures for data pipelines

7
Seeks continuous data performance improvement and ensures security of information

8
Creates and implements effective metrics and monitoring processes

9
May lead small projects with manageable risks and resource requirements

10
Acts as a resource and impacts the quality of work for colleagues with less experience

Requirements

4+ years Data warehousing methodologies and modelling techniques

4+ years experience with cataloging, modeling, ingestion, processing, and streaming technologies and processes

Demonstrated ability to quickly learn new technologies

1+ years of Data Analysis experience

Experience with ETL concepts and tooling

Advanced ability to solve complex problems, drawing upon creativity, experience, and multiple sources of information

Advanced interpersonal skills, including the ability to build consensus

Advanced communication skills, including the ability to communicate complex or difficult information in straightforward manner

Ability to understand assigned work from a business perspective

Regular and predictable attendance

Insurance and/or reinsurance industry knowledge - PREFERRED

Technical Requirements Required

Expertise in SQL and database table design able to write structured and efficient queries on large data sets

Experience working with enterprise scale data, and understanding how to efficiently work with data at scale

Experience working in Massively Parallel Processing (MPP) Analytical Datastores such as Snowflake, Vertica, Big Query

Awareness of data visualization tools such as Tableau, and/or Power BI

Preferred

Experience leveraging dBT to develop data pipelines

General understanding of Snowflake Architecture

Basic understanding of agile process flows

All qualified applicants will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Date Posted: 04 May 2024
Job Expired - Click here to search for similar jobs