Senior Runops Azure Data Engineer

Role: Senior RunOps Azure Data Engineer

Location: Deerfield, IL ,USA(Onsite)

Job Type: Full Time

Job Description:

Must Have Technical/Functional Skills

A Minimum of 5 Years' experience

Design & Develop data pipelines ETL/ELT solutions using Azure Data Factory, Databricks, and Synapse Analytics to process structured and unstructured data.

Implement and manage Azure Data Lake, Azure SQL Database and other data storage solutions.

Optimize data workflow and ensure data integrity using SQL/Synapse and other tools on Azure.

Azure Data Services: - Azure Data Factory, Databrick, Azure Synapse Analytics, Azure Data Lake.

Databases & Storage: -SQL Server, Azure SQL Database, Blob storage, Synapse Analytics.

Cloud Integration: Connect and integrate data source from on-prime, cloud and third-party APIs into Azure -based System.

Performance Optimization: Monitoring and enhance query performance, cost efficiency and scalability of data platform.

Automation and DevOps: Implement CI/CD pipeline for data workflows using Azure DevOps with tools like ARM templates.

Roles & Responsibilities

Production support & Monitoring:

Act as the primary escalation point for complex issues related to Azure Data factory, Databricks.

Monitor and troubleshoot data ingestion pipelines to ensure smooth data flow for digital marketing campaigns.

Perform root cause analysis (RCA) and implement permanent fixes for recuring issues.

Working Closely with team, providing guidance and resolving critical incident.

Data Pipeline Management (Azure Data factory & Databricks)

Manage and optimize ETL/ELT pipeline in Azure Data Factory and Databricks for data ingestion.

Implement data validation and error -handling mechanisms to maintain data integrity.

Adobe Campaign Classic Support & Digital Marketing data integration:

Ensure seamless data flow from Azure to Adobe Campaign Classic for marketing campaign execution.

Support Campaign team by troubleshooting data sync issues, segmentation errors and delivery failures

Incident & Problem management:

Handle high priority incidents, perform impact analysis and communicate resolution timelines.

Implement long-term fixes and preventive measures to minimize recurring issues.

Work with Adobe support and Microsoft Azure team for vendor escalations and resolution.

Performance Tunning & Optimization:

Monitor and improve Azure data factory pipeline execution times and data bricks cluster performance

Fine-Tune query performance for large -scale data ingestion.

Ensure Adobe Campaign classic campaigns run efficiently with o ptimized data input.

Documentation and Knowledge Sharing

Maintain Detailed SOPs, troubleshooting guides and runbooks.

Conduct training session for team members on Azure Data factory, data brick and Adobe Campaign classic best practices. Document incident resolutions and RCA reports for future reference.

Generic Managerial Skills, If any

Preferred but not mandatory. The Candidate must primarily be a technical lead with hands-on development expertise.