Python Developer with pyspark experience
Python Developer with pyspark experience
Posted on :
18-01-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Contact Details:
1.Harika Mamidala
Email:
Cell:
Email:
Cell:
2.Saravanan Ganesan
Email:
Cell: (732)
Email:
Cell: (732)
Job Title: Python Developer with pyspark experience
Location: Charlotte NC
Duration: 1824 Months
Years of Experience: 3 Yrs.
Required Hours/Week: 40hrs./Week
Notes:
- Python developer with pyspark experience and Large Language Model (LLM) is a must have skill
Job Description:
- End client is looking for a skilled Python Developer with expertise in PySpark to join our data engineering team.
- The ideal candidate will have a strong background in OOPS concept and LLM side( refers to AI )
Key Responsibilities:
- Collaborate with data scientists analysts and stakeholders to understand data requirements and implement solutions.
- Ensure the performance reliability and scalability of data processing workflows.
- Write clean efficient and maintainable code while following best practices.
- Perform code reviews debugging and troubleshooting of existing solutions.
Required Qualifications:
- Professional experience in Python development.
- Handson experience with PySpark for big data processing.
- Strong understanding of distributed computing concepts and frameworks (e.g. Spark).
- Experience with data integration and processing of large datasets in production environments.
- Familiarity with databases (SQL/NoSQL) and data storage solutions.
- Proficient in version control systems like Git.
Preferred Skills:
- Experience with cloud platforms (e.g. AWS Azure or GCP) and their data processing tools.
- Knowledge of workflow orchestration tools (e.g. Apache Airflow AutoSys).
- Exposure to Hadoop Kafka or similar big data technologies.
- Strong problemsolving and communication skills.
Employment Type
Full Time
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
