Job Title: Data engineering consultant
Experience:
7-9 Years
Notice
period: Immediate to 15 days
Location: Bangalore
JD:
Key
Responsibilities:
· Leverage your expertise in data
engineering, including data ingestion, transformation, storage, and retrieval
processes. Design and implement scalable data solutions to meet business
requirements.
· Demonstrate in-depth knowledge and
hands-on experience with Azure services and components relevant to data
engineering, such as Azure Data Lake Storage, Azure Databricks, Azure SQL
Database, Azure Synapse Analytics, etc.
· Manage and optimize data lake
environments, including data ingestion pipelines, data partitioning, data
cataloging, and data governance practices.
· Possess a strong understanding of
databases, including relational databases (e.g., SQL Server, MySQL) and NoSQL
databases (e.g., Cosmos DB, MongoDB). Design and optimize database schemas and
queries for performance and scalability.
· Proficient in programming languages
such as Python, PySpark, SQL, and others to develop data processing pipelines,
ETL workflows, and data manipulation scripts.
· Develop and implement automated data
security solutions, including data encryption, access control mechanisms, data
masking techniques, and compliance monitoring.
· Deep understanding of Azure services
and components relevant to data security, such as Azure Active Directory (Azure
AD), Azure Key Vault, Azure Policy, Managed identities, database security
policies, etc.
· Collaborate with cross-functional
teams including data scientists, analysts, and developers to deliver end-to-end
data solutions. Document technical designs, data models, and solution
architectures.
Qualifications
and Skills:
· Bachelor's degree in Computer
Science, Engineering, or related field. Master's degree preferred.
· 7-9 years of experience in data
engineering, with specific experience in Azure cloud technologies.
· Strong knowledge of data lakes, data
warehousing concepts, and big data technologies.
· Proficiency in PySpark (or similar
languages) for data processing and analytics.
· Hands-on experience with Azure
services like Azure Data Lake Storage, Azure Databricks, Azure SQL Database,
Azure Synapse Analytics, etc.
· Experience in automating data
security solutions and implementing data governance practices.
· Familiarity with data encryption,
access control, and compliance standards (e.g., GDPR, HIPAA).
· Excellent analytical,
problem-solving, and troubleshooting skills.
· Strong communication, collaboration,
and client-facing skills.
· Azure certifications (e.g., Azure
Data Engineer, Azure Solutions Architect) are a plus.
V 0.0.1