• Big data - Streamsets Admin

Industry Insurance
Location Bangalore
Experience Range 7 - 14 Years
Qualification any
Not active

Functional Any Other
Job Description
About Us
“Quess IT Staffing is India’s largest IT staffing company with over 20 years of experience in staffing IT professionals in 300+ companies across levels and skillsets. Our 10,000+ associates deployed in 80+ cities and towns are proficient in over 500 technological skills. Our associates help enable cutting edge solutions some of the biggest names across industried. Quess IT Staffing is a division of Quess Corp Limited, India’s leading business services provider and largest domestic private sector employer. Quess Corp Limited is - ‘A Great Place to Work’ certified – a testament to our excellent culture, people, and processes.”
About Company
www.magna.in
Roles and Responsibility

Job Description:

  • Experience with MDM data governance tools like Collibra
  • Expertized in Java, Python or Scala
  • Experience with Hadoop/Spark and big data analysis
  • Expertized writing scripts and code in multiple languages
  • Experience in Data Ingestion into Hadoop and Big Data Technologies
  • Experience with Stremsets and Kafka
  • Good verbal and written communication skills
  • ETL, ELT and/or reporting experience
  • Knowledge of Data Science Tools and Technologies

 

Roles and Responsibilities:

  • Building Hadoop Cluster, capacity planning, expanding and upgrading the clusters
  • HDFS support and Maintenance
  • Cluster Monitoring and Troubleshooting
  • Manage and review Hadoop, and Big Data Tools logs
  • Work with infrastructure teams to install, upgrade and patches as required
  • Work with data warehouse, security, and network and storage teams to implement and troubleshoot
  • Design, implement and maintains security at Hadoop and database level
  • Understanding of Security, Authentication, and Authorization concepts, i.e., Encryption, Kerberization, SSL, LDAP, etc..  

 

Skills:

Hadoop Expert, Streamsets Expert, Kafka Expert, Big Data Advanced, SQL/NOSQL Advanced, Scripting java/Python, Shell Advanced, Unix Expert, DevOps Advanced, Databases Expert, Platform Administration Advanced

 

Desired candidate
Good Linux knowledge, understanding of shell, debugging performance issues etc.
A+| A| A-