Big Data Developer

Roles and Responsibilities:

Develop and maintain data pipelines using BigData processes

Focus on ingesting storing processing and analyzing large datasets

Work closely with data science team to implement data analytics pipelines.

Help define data governance policies and support dataversioning processes.

Maintain security and data privacy working closely with data protection officer.

Analyze vast number of data stores to uncover insights

Enhancing data collection procedures to include all relevant information for developing analytic systems.

Processing cleansing and validating the integrity of data to be used for analysis.

Analyzing large amounts of information to find patterns and solutions.

Developing prediction systems and machine learning algorithms

Presenting results in a clear manner.

Propose solutions and strategies to tackle business challenges

Collaborate with Business and IT teams.

Required skills and qualifications:

Bache Degree in Engineering or Computer Science or equivalent OR Master in Computer Applications or equivalent.

10 years of software development experience and leading teams of engineers and scrum teams

5 years of handson experience of working with Informatica Oracle

Solid Datawarehousing concepts Knowledge of Financial reporting ecosystem will be a plus

5 years of experience within Data Engineering/ Data Warehousing using Big Data technologies will be a addon

Expert on Distributed ecosystem

Handson experience with programming using Core Java or Python/Scala

Expert on Hadoop and Spark Architecture and its working principle