PySpark Lead
PySpark Lead
Posted on :
16-10-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Job Description:
- Lead a team of data engineers in the design and implementation of big data solutions using PySpark.
- Collaborate with crossfunctional teams to understand business needs and develop datadriven solutions.
- Design and implement scalable and robust data pipelines using PySpark.
- Ensure data accuracy and integrity by implementing data validation and quality checks.
- Mentor and coach team members in PySpark and big data best practices.
- Stay uptodate with the latest developments in big data technologies and incorporate them into the teams workflow.
Requirements
Requirements:
- 8 years in Pyspark/ Data engineer development and implementation
- Bachelors or Masters degree in Computer Science Engineering or a related field.
- Proven experience as a PySpark Lead or similar role.
- Expertise in PySpark and big data technologies such as Hadoop Hive and Spark.
Requirements- Bachelor s or master s degree in computer science, Engineering, or a related field. Previous experience of 5+ years in Project management roles, preferably within software development projects. Strong leadership and team management skills, with the ability to motivate and guide technical teams towards project success. In-depth knowledge of software development methodologies, including Agile, Scrum, or Kanban. Excellent communication skills, with the ability to interact effectively with technical teams, stakeholders, and senior management. Experience in managing multiple projects simultaneously and prioritizing tasks based on business needs. Strong problem-solving and decision-making abilities, with a focus on delivering solutions to complex technical challenges. Familiarity with project management tools and software development lifecycle tools. Certifications in project management (PMP, PMI-ACP) or Agile methodologies (Scrum Master, SAFe) are a plus.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
