PysparkSQL Developer
Posted on :
12-07-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Do you love a career where you Experience Grow & Contribute at the same time while earning at least 10% above the market If so we are excited to have bumped onto you.
Learn how we are redefining the meaning of work and be a part of the team raved by Clients Jobseekers and Employees.
If you are a PysparkSQL Developer and looking for excitement challenge and stability in your work then you would be glad to come across this page.
We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.
Check if you are up for maximizing your earning/growth potential leveraging our Disruptive Talent Solution.
Role: PysparkSQL Developer
Location: Hyderabad Bangalore Pune
Hybrid Mode Position
Exp: 58 Years
Exp: 58 Years
Requirements
We are seeking a highly skilled Senior Data Engineer with strong SQL skills and experience in PySpark to join our team. The ideal candidate will have 58 years of experience including leadership in software development and scrum teams. This role involves designing and developing optimized data pipelines for batch and realtime data processing.
Mandatory Requirements:
- SQL Skills: Proficient in writing complex SQL programs.
- PySpark Experience: Proven experience in building and developing programs using PySpark.
- Experience: 58 years in software development; exceptional candidates with 35 years of experience will be considered.
Qualifications:
- Bachelor s degree in Engineering Computer Science or equivalent; or a Master s degree in Computer Applications or equivalent.
- 6 years of software development experience with team leadership.
- 3 years of handson experience with MapReduce Hive and Spark (Core SQL and PySpark).
- Solid understanding of data warehousing concepts.
- Knowledge of the financial reporting ecosystem is a plus.
Skills:
- Expertise in distributed ecosystems.
- Handson experience with Core Java or Python/Scala programming.
- Indepth knowledge of Hadoop and Spark architecture and principles.
- Proficiency in writing and optimizing complex SQL (Hive/PySparkdataframes) for processing large datasets.
- Experience in UNIX shell scripting.
- Ability to design and develop optimized data pipelines for batch and realtime data processing.
- Proven experience in the analysis design development testing and implementation of system applications.
- Ability to develop and document technical and functional specifications and analyze software and system processing flows.
Preferred Qualifications:
- Knowledge of cloud platforms (GCP/AWS) and experience in building microservices and scalable solutions.
- 1 years of experience in designing and building solutions using Kafka streams or queues.
- Experience with GitHub/Bitbucket and leveraging CI/CD pipelines.
- Experience with NoSQL databases (HBase Couchbase MongoDB) is a plus.
- Excellent technical and analytical aptitude.
- Strong communication skills.
- Exceptional project management skills.
- Resultsdriven mindset.
Benefits
CEO Message: Click Here
Clients Testimonial: Click Here
We are seeking a highly skilled Senior Data Engineer with strong SQL skills and experience in PySpark to join our team. The ideal candidate will have 5-8 years of experience, including leadership in software development and scrum teams. This role involves designing and developing optimized data pipelines for batch and real-time data processing. Mandatory Requirements: SQL Skills: Proficient in writing complex SQL programs. PySpark Experience: Proven experience in building and developing programs using PySpark. Experience: 5-8 years in software development; exceptional candidates with 3-5 years of experience will be considered. Qualifications: Bachelor s degree in Engineering, Computer Science, or equivalent; or a Master s degree in Computer Applications or equivalent. 6+ years of software development experience with team leadership. 3+ years of hands-on experience with MapReduce, Hive, and Spark (Core, SQL, and PySpark). Solid understanding of data warehousing concepts. Knowledge of the financial reporting ecosystem is a plus. Skills: Expertise in distributed ecosystems. Hands-on experience with Core Java or Python/Scala programming. In-depth knowledge of Hadoop and Spark architecture and principles. Proficiency in writing and optimizing complex SQL (Hive/PySpark-dataframes) for processing large datasets. Experience in UNIX shell scripting. Ability to design and develop optimized data pipelines for batch and real-time data processing. Proven experience in the analysis, design, development, testing, and implementation of system applications. Ability to develop and document technical and functional specifications and analyze software and system processing flows. Preferred Qualifications: Knowledge of cloud platforms (GCP/AWS) and experience in building microservices and scalable solutions. 1+ years of experience in designing and building solutions using Kafka streams or queues. Experience with GitHub/Bitbucket and leveraging CI/CD pipelines. Experience with NoSQL databases (HBase, Couchbase, MongoDB) is a plus. Excellent technical and analytical aptitude. Strong communication skills. Exceptional project management skills. Results-driven mindset.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
