Backfill for someone who completed their contract, they are renewing as he couldn't problem solve.
Hiring a Senior Data Engineer
Must HAVE: Snowflake, DBT as a transformation tool, if they are a SQL expert they can likely get up to speed in DBT, must have worked with large data sets (RGA IS AT PETABYTES),
RGA uses Github and GIT as source control and they run agile.
This person will be creating new data pipelines using DBT to load data into snowflake
SOFT SKILLS MUST HAVE: this developer is embedded with multiple teams and will need to have a mindset of working through obstacles, and be a problem solver. They need to get to the underlying ask and build data pipelines.
RGA Effort: They have numerous transactional systems, they have been working on different workloads. they are moving the transactional data to AWS with SNOWFLAKE ON TOP, S3 on the backend. They have developed a robust governance model to access the data. Some of the framework is also built and they are ingesting the data into snowflake.
First 30 days: - come up to speed on technical environment, as well as start writing some data pipelines, and start to build relationships with the team.
Position Overview
Independently designs, develops, tests, implements, documents, and supports big data/ data fabric platforms, including big data cataloging, modeling, ingestion, streaming, processing, and storage technologies and processes. Applies a general understanding of the source systems, and leverages general knowledge of data warehouse and business intelligence technologies, as well as processes, to execute responsibilities. Must have effective communication and collaboration skills to ensure work output meets business needs.
Responsibilities
1
Creates and supports the process to ingest data from source systems and place it into the data fabric and analytics platforms
2
Performs big data pipeline design and testing, including data design, data architecture, catalog, and repository creation
3
Designs, develops, and maintains the data technologies and architectures
4
Works with business and IT stakeholders to optimize information by defining business requirements and populating the data fabric
5
Collaborate with business to develop models and transformations that meet advanced analytics needs
6
Recommends improvements and applies standards, processes, and procedures for data pipelines
7
Seeks continuous data performance improvement and ensures security of information
8
Creates and implements effective metrics and monitoring processes
9
May lead small projects with manageable risks and resource requirements
10
Acts as a resource and impacts the quality of work for colleagues with less experience
Requirements
4+ years Data warehousing methodologies and modelling techniques
4+ years experience with cataloging, modeling, ingestion, processing, and streaming technologies and processes
Demonstrated ability to quickly learn new technologies
1+ years of Data Analysis experience
Experience with ETL concepts and tooling
Advanced ability to solve complex problems, drawing upon creativity, experience, and multiple sources of information
Advanced interpersonal skills, including the ability to build consensus
Advanced communication skills, including the ability to communicate complex or difficult information in straightforward manner
Ability to understand assigned work from a business perspective
Regular and predictable attendance
Insurance and/or reinsurance industry knowledge - PREFERRED
Technical Requirements Required
Expertise in SQL and database table design able to write structured and efficient queries on large data sets
Experience working with enterprise scale data, and understanding how to efficiently work with data at scale
Experience working in Massively Parallel Processing (MPP) Analytical Datastores such as Snowflake, Vertica, Big Query
Awareness of data visualization tools such as Tableau, and/or Power BI
Preferred
Experience leveraging dBT to develop data pipelines
General understanding of Snowflake Architecture
Basic understanding of agile process flows
All qualified applicants will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Date Posted: 04 May 2024
Job Expired - Click here to search for similar jobs