Junior Big Data Engineer

We are seeking a motivated Big Data Engineer to join our data engineering team. This entrylevel position is ideal for recent graduates who are passionate about big data technologies and eager to apply their knowledge in a professional setting. The successful candidate will assist in designing building and maintaining our big data infrastructure and pipelines.

Key Responsibilities:

• Assist in Data Pipeline Development:

  • Help design develop and maintain scalable data pipelines to process large volumes of data.
  • Support the implementation of ETL (Extract Transform Load) processes to ensure data integrity and quality.

• Data Storage and Management:

  • Learn to manage and optimize big data storage solutions (e.g. HDFS NoSQL databases).
  • Assist in the development and maintenance of data warehouses and data lakes.

• Data Processing:

  • Gain handson experience with big data processing frameworks such as Apache Spark Hadoop and Kafka.
  • Support the development of realtime and batch data processing solutions.

• Data Integration:

  • Help integrate data from various sources ensuring data consistency and accuracy.
  • Collaborate with data scientists analysts and other stakeholders to understand data requirements.

• Performance Optimization:

  • Learn to optimize data processing performance and troubleshoot issues in data pipelines.
  • Assist in implementing best practices for data security and compliance.

• Collaboration and Learning:

  • Work closely with crossfunctional teams to gather requirements and deliver data solutions.
  • Participate in training sessions and mentorship programs to develop technical skills.

• Continuous Improvement:

  • Stay updated with the latest industry trends and technologies in big data.
  • Contribute to the continuous improvement of the data engineering processes and tools.

Required Qualifications:

• Education:

  • Bachelor’s degree in Computer Science Information Technology or a related field.

• Technical Skills:

  • Basic understanding of big data technologies (e.g. Hadoop Spark Kafka) through coursework or projects.
  • Familiarity with ETL processes and tools.
  • Basic programming skills in Java Scala or Python.
  • Knowledge of SQL and NoSQL databases.
  • Understanding of cloud platforms (AWS Azure Google Cloud) and their big data services is a plus.

• Experience:

  • Relevant internships or academic projects involving big data technologies are preferred but not required.

Soft Skills:

• Strong problemsolving and analytical skills.
• Good communication and collaboration skills.
• Ability to learn quickly and adapt to new technologies.
• Detailoriented with a focus on data quality and accuracy.