Azure Data Engineer

Herndon, Virginia

Softthink Solutions
Apply for this Job
About the Role:

We seek a skilled Data Engineer to support multiple International organization projects. The consultant will work with a multidisciplinary team, delivering data solutions using cutting-edge technologies in a highly collaborative environment.

Key Responsibilities:

Design and implement data solutions using Microsoft Azure (preferred), AWS, or Google Cloud.

Develop and optimize ETL/ELT processes using Azure Data Factory, Databricks, PySpark, SQL Server, and SSIS.

Manage and optimize Data Lakes/Delta Lakes and complex data transformations.

Build and maintain CI/CD pipelines using Azure DevOps.

Migrate legacy data systems to modern platforms.

Required Skills & Experience:

5+ years as a Data Engineer.

Expertise in Microsoft Azure Data Services (Data Factory, Logic Apps, Azure Functions, Databricks, Synapse, DevOps).

Strong SQL (T-SQL, Spark SQL) and Python/PySpark experience.

Proven experience with Data Lakes, Delta Lakes, and ETL pipelines.

Experience with CI/CD, PowerShell, and Bash scripting.

Strong communication, collaboration, and problem-solving skills.

Preferred:

AI/ML and Business Intelligence (BI) knowledge is a plus.

Experience in Agile methodologies (SCRUM, PMP, PRINCE2).

Certifications: Azure Data Engineer Associate, DP-500, or related.

This is a remote position.

Date Posted: 11 March 2025
Apply for this Job