SUMMARY:
A Senior Administrator in the Cloud Data Platform team, operating within the Enterprise Data Services department, is tasked with orchestrating operational functions between Cloud Data Platform Leadership, Engineering and Analytics teams, and customers of the client. This role involves applying software engineering principles to automate data infrastructure operations, encompassing the deployment of Azure Data Infrastructure and Services (Infrastructure-As-Code - IaC), administration of the enterprise data lake utilizing the Snowflake data platform, and managing security protocols. The position necessitates expertise in on-premises Data Center activities to guide and automate the migration of traditional assets to the cloud-native environment. The Senior Administrator will devise innovative solutions to monitor the performance of cloud-native technologies and costs, ensuring a balance between innovation pace and adherence to enterprise service level agreements (SLAs) through the establishment of Service Level Indicators (SLIs) and Service Level Objectives (SLOs).
PRINCIPAL DUTIES AND RESPONSIBILITIES:
• Oversee Azure Services and applications used by the Cloud Data Platform, including security access and user management, such as Azure Data Factory, Azure Functions, Databricks, Key vault, Azure Blob storage, and Azure DevOps.
• Manage the Snowflake data platform, implementing Role-Based Access Control (RBAC) framework for secure access.
• Conduct onboarding/training sessions for Cloud Data Platform users.
• Automate operational tasks using Infrastructure as Code (IaC) and DevOps CI/CD tools and services.
• Troubleshoot issues and performance for on-prem tools and cloud services.
• Handle Incident Response, Issue Troubleshooting, Log Analysis, and Postmortems.
• Collaborate with various teams to ensure high availability, including infrastructure, network, database, application, and analytics teams.
• Design solutions to monitor development activities from Data Engineering teams.
• Implement and support enterprise security standards in the Cloud data infrastructure.
• Develop and utilize monitoring tools to optimize performance, provide high availability, and meet job SLAs.
• Collaborate with application and product teams to understand system requirements and propose necessary modifications to data flow, data security, and retention.
• Propose solutions to enhance product stability, scalability, and performance, with a focus on automation.
• Evaluate Cloud Data Platform users' use cases and provide feedback and guidance.
• Escalate support issues with internal teams and third-party vendors.
• Participate in rotational on-call duty for supporting the production environment.
• Share knowledge and experience to contribute to the overall team's capabilities.
• Assist team members with production issues, offering support, guidance, and communication with stakeholders when necessary.
REQUIRED SKILLS AND KNOWLEDGE:
• Proficiency in SQL.
• Data warehousing and Business Intelligence.
• Familiarity with Git, DevOps, CI/CD.
• Understanding of Role-Based Access Control (RBAC) security model.
• Knowledge of distributed computing paradigm and experience in technologies like Spark, Impala, NiFi, Azure Data Factory, Azure Functions, and Snowflake.
• Experience managing code and dependencies, building and maintaining CI/CD pipelines in Azure DevOps/GitHub.
• Design and implementation of Infrastructure as Code (IaaC) solutions using Terraform or similar.
• Researching emerging technologies, trends, standards, and products.
• Full stack design and development experience within the Azure ecosystem combined with Snowflake.
• Understanding of Big Data technologies such as Spark, NiFi, Impala, Sqoop, Hive, and File formats like Parquet, AVRO, ORC, CSV, JSON.
• Ability to communicate complex information to internal and external audiences.
PREFERRED SKILLS AND KNOWLEDGE:
• Production-level hands-on expertise in configuring modern Big Data solutions.
• Production-level maintenance of Big Data solutions, including upgrades, updates, OS patching, troubleshooting hardware and software issues.
• Understanding of Azure Networking concepts.
• Snowflake Administration experience.
• Disaster Recovery for Data Solutions.
EDUCATION AND EXPERIENCE REQUIRED:
• Bachelor's degree in Computer Science or a related field.
• 2+ years of experience in Azure/AWS or GCP cloud.
• 2+ years of experience in Snowflake.
• 5+ years of professional experience with enterprise on-prem IT assets or matching cloud experience.
• 3 years of relevant DevOps or DataOps Experience.
• 3 years of managing enterprise applications and databases.
• 3 years of experience managing security access.
EDUCATION AND EXPERIENCE PREFERRED:
• Master's Degree in Computer Science, Data Science, or related field.
• Performance tuning in Big Data environments, Spark, ADF, Snowflake.
• IaC Development with Terraform.
• Snowflake Administration or related Database Administration.
• Cloudera distribution of Hadoop.
• Healthcare industry knowledge.
CERTIFICATIONS PREFERRED:
• Azure Certifications AZ-900, AZ-104.
• Azure DevOps Certifications AZ-400.
• SnowPro Snowflake.
• SnowPro Advanced: Administrator.
• Hadoop/Big Data/Databricks Certifications.