Job Title: Consultant-Data
Engineering
Experience: 10-12 Years
Notice period: Immediate to 15 days
Location: Bangalore
JD:
Responsibilities:
·
Experience in supporting large scale data
engineering projects
· Leads or participates in the systems software development
lifecycle, which includes research, new development, modification, security,
correction of errors, reuse, re-engineering and maintenance of software
products and data pipelines
· Develops technical tools and programming to cleanse, organize
and transform data and to maintain, protect and update data structures and
integrity on an automated basis.
· Design & develop processes, automations and systems to
capture, manage, store and utilize structured and unstructured data to generate
actionable insights and solutions
· Responsible for the maintenance, improvement, cleaning, and
manipulation of data in the data lake.
· Attend to data job failures and data issues reported by users
· Proactively analyzes and evaluates the data pipeline failures
and triage issues appropriately based on the SLAs
· Work with engineering teams to review solutions for operational
ease & are built per standards.
· Works in collaboration with data engineers, data scientists,
architects and business users to support the data needs and create actionable
insights to identify data quality issues.
· Designs, codes, tests and debugs software according to standards,
policies and procedures.
· Mentoring junior team members on technical and functional skills.
Should be a great team player. Functional knowledge of business processes is
required.
Skills
· Possesses and applies a broad knowledge of application
programming processes and procedures to the completion of complex assignments.
· Competent to analyze diverse and complex problems.
· Advanced ability to effectively troubleshoot program errors.
· Build high reliability, high quality, high volume data pipelines
· Setup batch, micro batch, streaming pipelines
· Data ingestion, transformation, processing batch & near real time
· Automated tests and tie outs, self-healing data jobs
· Build products that can support themselves with none to minimal
support after rollout
· Ability to communicate complex insights in a precise and
actionable manner
· Mindset to think differently; alignment to Industry standards;
awareness of emerging technologies and industry trends