Technology Engineer II

Job Description

AbbVie Information Research is seeking a Data Engineer who would contribute to the architecture, design, and development of the Data & Analytics Platform supporting world-class research and development at AbbVie. As a Data Engineer, you will be a core member of a high-performance team of data engineers and architects focusing on driving technology innovation and continuous improvement. This role collaborates with solution architects, product owners, program managers, business analysts, infrastructure teams, and service providers to deliver the solutions.

In this role you will be responsible for:

Design and deliver various data engineering activities to enhance the data platform, including data warehousing, master data management, data cataloging, system integration, data streaming, data visualization, data analysis, and data ops.

Building required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS, Cloudera, Spark, python, Modak Nabu, and SQL technologies

Work with R&D/life science-centric datasets and utilize this knowledge to develop TL(Standard Datasets) and ATL (asset-specific datasets).

Maintain CI/CD Azure pipeline for production code deployment for Madak Nabu and Cloudera Public Cloud

Monitor, maintain, and debug Datahub Clusters, Virtual Warehouses, and ML Workspaces.

Develop the data processing engine framework using scala, Iceberg and Cloudera

Ensure compliance with applicable AbbVie software development lifecycle policies and procedures.