drjobs PysparkSQL Developer English

PysparkSQL Developer

صاحب العمل نشط

1 وظيفة شاغرة
drjobs

حالة تأهب وظيفة

سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكتروني
Valid email field required
أرسل الوظائف
drjobs
أرسل لي وظائف مشابهة
drjobs

حالة تأهب وظيفة

سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكتروني

Valid email field required
أرسل الوظائف
الخبرة drjobs

3-8سنوات

موقع الوظيفة drjobs

حيدر آباد - الهند

الراتب الشهري drjobs

لم يكشف

drjobs

لم يتم الكشف عن الراتب

عدد الوظائف الشاغرة

1 وظيفة شاغرة

الوصف الوظيفي

Do you love a career where you Experience Grow & Contribute at the same time while earning at least 10% above the market If so we are excited to have bumped onto you.


We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.



Requirements


We are seeking a highly skilled Senior Data Engineer with strong SQL skills and experience in PySpark to join our team. The ideal candidate will have 58 years of experience including leadership in software development and scrum teams. This role involves designing and developing optimized data pipelines for batch and realtime data processing.

Mandatory Requirements:

  • SQL Skills: Proficient in writing complex SQL programs.
  • PySpark Experience: Proven experience in building and developing programs using PySpark.
  • Experience: 58 years in software development; exceptional candidates with 35 years of experience will be considered.

Qualifications:

  • Bachelor s degree in Engineering Computer Science or equivalent; or a Master s degree in Computer Applications or equivalent.
  • 6 years of software development experience with team leadership.
  • 3 years of handson experience with MapReduce Hive and Spark (Core SQL and PySpark).
  • Solid understanding of data warehousing concepts.
  • Knowledge of the financial reporting ecosystem is a plus.

Skills:

  • Expertise in distributed ecosystems.
  • Handson experience with Core Java or Python/Scala programming.
  • Indepth knowledge of Hadoop and Spark architecture and principles.
  • Proficiency in writing and optimizing complex SQL (Hive/PySparkdataframes) for processing large datasets.
  • Experience in UNIX shell scripting.
  • Ability to design and develop optimized data pipelines for batch and realtime data processing.
  • Proven experience in the analysis design development testing and implementation of system applications.
  • Ability to develop and document technical and functional specifications and analyze software and system processing flows.

Preferred Qualifications:

  • Knowledge of cloud platforms (GCP/AWS) and experience in building microservices and scalable solutions.
  • 1 years of experience in designing and building solutions using Kafka streams or queues.
  • Experience with GitHub/Bitbucket and leveraging CI/CD pipelines.
  • Experience with NoSQL databases (HBase Couchbase MongoDB) is a plus.
  • Excellent technical and analytical aptitude.
  • Strong communication skills.
  • Exceptional project management skills.
  • Resultsdriven mindset.


Benefits



We are seeking a highly skilled Senior Data Engineer with strong SQL skills and experience in PySpark to join our team. The ideal candidate will have 5-8 years of experience, including leadership in software development and scrum teams. This role involves designing and developing optimized data pipelines for batch and real-time data processing. Mandatory Requirements: SQL Skills: Proficient in writing complex SQL programs. PySpark Experience: Proven experience in building and developing programs using PySpark. Experience: 5-8 years in software development; exceptional candidates with 3-5 years of experience will be considered. Qualifications: Bachelor s degree in Engineering, Computer Science, or equivalent; or a Master s degree in Computer Applications or equivalent. 6+ years of software development experience with team leadership. 3+ years of hands-on experience with MapReduce, Hive, and Spark (Core, SQL, and PySpark). Solid understanding of data warehousing concepts. Knowledge of the financial reporting ecosystem is a plus. Skills: Expertise in distributed ecosystems. Hands-on experience with Core Java or Python/Scala programming. In-depth knowledge of Hadoop and Spark architecture and principles. Proficiency in writing and optimizing complex SQL (Hive/PySpark-dataframes) for processing large datasets. Experience in UNIX shell scripting. Ability to design and develop optimized data pipelines for batch and real-time data processing. Proven experience in the analysis, design, development, testing, and implementation of system applications. Ability to develop and document technical and functional specifications and analyze software and system processing flows. Preferred Qualifications: Knowledge of cloud platforms (GCP/AWS) and experience in building microservices and scalable solutions. 1+ years of experience in designing and building solutions using Kafka streams or queues. Experience with GitHub/Bitbucket and leveraging CI/CD pipelines. Experience with NoSQL databases (HBase, Couchbase, MongoDB) is a plus. Excellent technical and analytical aptitude. Strong communication skills. Exceptional project management skills. Results-driven mindset.

نوع التوظيف

دوام كامل

نبذة عن الشركة

الإبلاغ عن هذه الوظيفة
إخلاء المسؤولية: د.جوب هو مجرد منصة تربط بين الباحثين عن عمل وأصحاب العمل. ننصح المتقدمين بإجراء بحث مستقل خاص بهم في أوراق اعتماد صاحب العمل المحتمل. نحن نحرص على ألا يتم طلب أي مدفوعات مالية من قبل عملائنا، وبالتالي فإننا ننصح بعدم مشاركة أي معلومات شخصية أو متعلقة بالحسابات المصرفية مع أي طرف ثالث. إذا كنت تشك في وقوع أي احتيال أو سوء تصرف، فيرجى التواصل معنا من خلال تعبئة النموذج الموجود على الصفحة اتصل بنا