Skills Required:
·
Technical expertise: HADOOP, SQOOP, PIG, HIVE, HBASE, OOZIE, FLUME, ZOOKEEPER,
Kerberos, Rangers, Kafka, Strom, Hortonworks
·
Java Technologies: Core Java
·
Database: MySQL, Oracle
·
Bug Tracking Tools: BMC Remedy, HP
Quality Center
·
Operating Systems: Windows, Linux
Key Roles and Responsibilities:
·
Manage the cluster resources by
implementing fair and capacity scheduler
·
Scheduling jobs
using OOZIE workflow and crontab
·
Benchmark, perform backup and
disaster recovery of Name Node metadata and important sensitive data residing
on cluster
·
Optimize performance of
HBase/Hive/Pig/Sqoop/Hadoop jobs
·
Configuring Name Node High
Availability
·
Understand the security
requirements for Hadoop and integrating with Kerberos authentication infrastructure
·
KDC server setup, crating realm/domain,
managing principles, generation key tab file each service and managing key tab
using key tab tools
·
Knowledge on Hadoop Security
(Ranger and Knox gateway)
·
Manage the new users, setting up
the Kerberos principals and providing the access to the required tools and data
rooms
·
Importing and exporting data
using Sqoop from RDBMS MySQL, Oracle, Teradata and also using fast loaders and
connectors Experience
·
Experience in handling multiple
relational databases
·
Assisted Developers with problem
resolution
·
Key role in the team and
communicates across the team
·
Effective problem solving skills
and outstanding interpersonal skills
V 0.0.1