Data Engineer III

Job Description

OVERVIEW
The Data Management team is responsible for all things data for our client. Most importantly, the team is responsible for constructing high quality datasets that enable business stakeholders and our client's world-class Analytics department to make data informed decisions. Data engineers, combining Software Engineering and Database Engineering, serve as a primary resource for expertise with writing scripts and SQL queries, monitoring database stability, and assisting with data governance ensuring availability for business-critical systems. The Data Engineer III works with a team of engineers of varying levels to design, develop, test, and maintain software applications and programs. The Data Engineer III will be expected to work independently when needed to solve the most complex problems encountered. They will be expected to be a leader and a mentor.

This person has the opportunity to work primarily remote in the KC or surrounding areas, making occasional visits to the office.

ESSENTIAL DUTIES

The essential duties for this role include, but are not limited to:

• Architect replacements of current Data Management systems with respect to all aspects of data governance
• Architect advanced services with multiple data pipelines to securely and appropriately store company assets in our enterprise data stores.
• Technically advise any member of the data engineering department, providing direction when multiple paths forward present themselves.
• Actively participate as a leader in regular team meetings, listening and ensuring that one is assisting others at every chance for growth and development.
• Serve as a primary advisor to Data Engineering Manager to identify and bring attention to opportunities for technical improvements, reduction of technical debt, or automation of repeated tasks.
• Write advanced Extract, Transform, and Load (ETL) scripts to integrate data of various formats into enterprise data stores.
• Take ownership (both individually and as part of a team) of services and applications
• Write complex SQL queries, scripts, and stored procedures to reliably and consistently modify data throughout our organization according to business requirements
• Collaborate directly and independently with stakeholders to build familiarity, fully understand their needs, and create custom, modular, and reliable solutions to resolve their requests
• Document and demonstrate solutions by developing documentation, flowcharts, layouts, diagrams, charts, code comments and clear code
• Work with Project Managers, Solution Architects, and Software Development teams to architect solutions for Company Initiatives on time, on budget, and on value.
• Independently architect solutions to problems of high complexity, and advise junior and mid-level engineers on problems of medium complexity.
• Create data pipelines using appropriate and applicable technologies from Amazon Web Services (AWS) to serve the specific needs of the business.
• Ensure 99.95% uptime of our company's services monitoring data anomalies, batch failures, and our support chat for one week per team cycle from 8am-9pm.
• Follow and embrace procedures of both the Data Management team and SVG Software Development Life Cycle (SDLC), including obtaining and retaining IT Security Admin III clearance.
• Support after hours and weekend releases from our internal Software Development teams.
• Actively participate in code review and weekly technicals with another more senior engineer or manager.
• Assist departments with time-critical SQL execution and debug database performance problems.

ROLE COMPETENCIES
The competencies for this role include, but are not limited to:

• Emotional Intelligence
• Drive for Results
• Continuous Improvement
• Communication
• Strategic Thinking
• Teamwork and Collaboration

Qualifications

The requirements to fulfill this position are as follows:

• Bachelor's degree in Computer Science, or a related technical field.
• 4-7 years of practical production work in Data Engineering.
• Advanced at reading code independently and understanding its intent
• Advanced at writing readable, modifiable code that solves business problems.
• Ability to construct reliable and robust data pipelines to support both scheduled and event based workflows
• Working directly with stakeholders to create solutions.
• Mentoring junior and mid-level engineers on best practices in programming, query optimization, and business tact
• Strong knowledge of the Python programming language.
• Strong understanding of SQL, databases, & query optimization