Hadoop Admin Ops / SRE role supporting NextGen Platforms built around Big Data Technologies (Hadoop, Spark, Kafka, Impala, Hbase, Docker-Container, Ansible and many more). Requires experience in cluster management of vendor based Hadoop and Data Science (AI/ML) products like Cloudera, DataRobot, C3, Panopticon, Talend, Trifacta, Selerity, ELK, KPMG Ignite etc.
DevOps Analyst is involved in the full life cycle of an application and part of an agile development process. They require the ability to interact, develop, engineer, and communicate collaboratively at the highest technical levels with clients, development teams, vendors, and other partners. The following section is intended to serve as a general guideline for each relative dimension of project complexity, responsibility, and education/experience within this role.
Works on complex, major, or highly visible tasks in support of multiple projects that require multiple areas of expertise
Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with a focus around Cloudera Hadoop, Jupyter Notebook, Openshift, Docker-Container Cluster Management and Administration
Integrates solutions with other applications and platforms outside the framework
He / She will be responsible for managing platform operations across all environments, which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident / problem / capacity management
Serves as a liaison between client partners and vendors in coordination with project managers to provide technical solutions that address user needs
Required Skills:
Hadoop, Kafka, Spark, Impala, Hive, Hbase, etc.
Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster, and Hadoop Administrator's role
Intimate knowledge of fully integrated AD/Kerberos authentication
Experience setting up optimum cluster configurations
Debugging knowledge of YARN
Hands-on with analyzing various Hadoop log files, compression, encoding, & file formats
Expert-level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, ZooKeeper, and Postgres
Strong technical knowledge: Unix/Linux; Database (Sybase/SQL/Oracle), Java, Python, Perl, Shell scripting, Infrastructure
Experience in Monitoring & Alerting, and Job Scheduling Systems
Being comfortable with frequent, incremental code testing and deployment
Strong grasp of automation / DevOps tools - Ansible, Jenkins, SVN, Bitbucket
Primary Skills:
Hadoop - Cloudera, Hortonworks, Apache
Secondary Skills:
Cloudera - HDFS, Impala, KUDU, HBase
Date Posted: 02 April 2025
Apply for this Job