Job Title: consultant data engineering
Experience:
8-10 Years
Notice
period: Immediate to 15 days
Location: Bangalore
JD:
Responsibilities:
· Design, develop, and maintain ETL
processes using Informatica or StreamSets to extract, transform, and load data
from various sources into Teradata and Greenplum data warehouse environments.
· Develop and optimize SQL queries,
macros, and stored procedures for data manipulation, transformation, and
analysis.
· Utilize Control-M scheduling tool to
orchestrate and automate data workflows and batch processes.
· Create and maintain Python scripts
to support data engineering tasks, business processes, and automation initiatives.
· Collaborate with data architects,
business analysts, and stakeholders to understand data requirements, design
data models, and implement data solutions.
· Implement data quality checks,
validation rules, and monitoring mechanisms to ensure data integrity and
accuracy.
· Work with Spark for big data
processing, data transformations, and analytics tasks.
· Troubleshoot data-related issues,
performance bottlenecks, and optimize data pipelines for efficiency and
scalability.
· Provide technical guidance, mentorship,
and support to junior team members.
· Stay updated with industry trends,
best practices, and emerging technologies in data engineering and analytics.
V 0.0.1