Job Title: Big Data Engineer
Experience:
4 to 12 Years
Notice
Period: Immediate to 15 days
Location: Bangalore
JD:
Key Responsibilities:
·
Reverse engineer SQL queries and Scala code to
understand functionality and identify opportunities for optimization.
·
Extract data from primary and secondary sources
using automated tools, ensuring data integrity and quality.
·
Analyze and interpret patterns and trends in
complex data sets using statistical tools and techniques.
·
Create database designs, data models, and
techniques for data mining to support business objectives.
·
Remove corrupted data, fix coding errors, and
troubleshoot data-related problems to maintain data accuracy.
·
Filter and review reports and performance
indicators to identify and correct code problems and improve data quality.
·
Assign numerical values to essential business
functions for performance assessment and comparison over time.
·
Analyze local, national, and global trends impacting
the organization and industry, providing insights for decision-making.
·
Prepare reports for management with trends,
patterns, and predictions derived from relevant data analysis.
·
Collaborate with programmers, engineers, and
management to identify process improvement opportunities and propose system
modifications.
·
Prepare final analysis reports for stakeholders,
explaining data analysis steps and enabling informed decision-making.
·
Utilize programming languages like SQL, Oracle,
R, and Python for data analysis and manipulation.
·
Develop technical proficiency in database
design, data models, data mining techniques, and segmentation strategies.
·
Handle reporting packages like Business Objects,
programming (JavaScript, XML, ETL frameworks), and databases for data analysis.
·
Use statistics and statistical packages like
Excel, SPSS, SAS for data set analysis and interpretation.
·
Utilize data processing platforms like Hadoop
and Apache Spark for data manipulation and analysis.
·
Explore data visualization software like Tableau
and Qlik for creating insightful visualizations and dashboards.
·
Apply accurate algorithms to datasets to find
solutions and improve data analysis accuracy.
·
Create and maintain data mapping (ACRS, MARSHA),
track ongoing issues, and support data-related queries on ongoing projects.
Qualifications:
·
Bachelor's degree in Computer Science,
Information Technology, Statistics, or related field.
·
4+ years of experience as a Data Analyst, Data
Engineer, or similar role.
·
Proficiency in Spark, Scala, SQL, and
programming languages like SQL, Oracle, R, and Python.
·
Strong analytical, problem-solving, and data
interpretation skills.
·
Experience with data processing platforms
(Hadoop, CouchDB) and statistical packages (Excel, SPSS, SAS).
·
Knowledge of data visualization software
(Tableau, Qlik) and reporting packages (Business Objects).
·
Excellent communication, collaboration, and
presentation skills.
·
Ability to work independently, manage
priorities, and meet project deadlines.
Understanding of data governance, database
design, data models, and data mining techniques.
V 0.0.1