Job Title: Principal Software Engineer
Experience:
8-9 Years
Notice
period: Immediate to 15 days
Location:
Bangalore
JD:
· Hadoop Administration (including
configuration, maintenance, support, backup and recovery of HDFS, YARN,
ZooKeeper, Hive, Hue, Spark, Kafka and HBase).
· Understand Hadoop?s Security
mechanisms and implement Hadoop Security (Apache Sentry, Kerberos, TLS/SSL).
· Understand the role of Certificate
Authorities, the setup of Certificates and their configuration in relation to
Linux and TLS/SSL.
· Understand the role of Certificate
Authorities, the setup of Certificates and their configuration in relation to
Linux and TLS/SSL.
· Install, upgrade, migrate Cloudera
Hadoop platforms in disk attached storage as well as Isilon based clusters.
· Work with development teams to set
appropriate performance configuration values for optimal performance.
Troubleshoot and determine solution and RCA for performance problems keeping in
mind the importance of efficient utilization of infrastructure.
Education
· Degree in Computer Science,
Engineering.
Experience
· HIGHLY PREFERRED - EXPERIENCE WITH
AZURE DATABRICKS.
· Proven track record with Hadoop
administration, 2+ years Hadoop cluster administration, expansion, and upgrade
in cloud hosted environments as well as local clusters(, HBase, HDFS, YARN,
Zookeeper)
· Hands on Experience in Monitor
Hadoop Cluster.
· Experience in creating scripting
solutions to extract performance details from Hadoop platform and generate
reports to educate leadership on infrastructure utilization and utilize the
data to perform infrastructure capacity management at cluster and tenant
levels.
Mandatory
experience:
· Demonstrates excellent communication
and business client presentation skills Helps clients identify business
challenges and implement innovative solutions to deliver the right outcomes.
· Works independently as well as
collaboratively with others.
· Contributes to the development of
innovative principles and ideas.
· Routinely exercises independent
judgment in developing methods, techniques and criteria for achieving
objectives.
· 5 or more years of experience in a
Platform Engineering/DataEngineering/Administrationrole or related area.
· Hands-on experience with a Hadoop
distribution (Cloudera).
· Hands-on experience troubleshooting
Java Virtual Machines (JVM's) in a clustered environment.
· Hands-on experience with distributed
file systems (HDFS).
· Hands-on experience working with the
following: Spark, Hive HBase, TLS/SSL.
· Exposure to large Linux environments
(including day-to-day operation, networking and security).
· Exposure to LDAP and LDAPS in a
large Linux/Active Directory environment.
· Excellent understanding of data,
data ingestion, data sensitivity, data management, data warehousing concepts.
· Ability to pick up new technologies
on their own quickly.
V 0.0.1