Data Engineer
Data Engineer
Posted on :
21-09-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Job Role: Data Engineer
Location:Pune GGN Bangalore Chennai
Exp:48 yrs
NP:immediate joiner and October 1st week candidate
Work Mode: Hybrid
Mandatory skills Pyspark AWS Python
Key Skills
- Design develop maintain efficient and scalable solutions using PySpark
- Ensure data quality and integrity by implementing robust testing validation and cleansing processes
- Integrate data from various sources including databases APIs external datasets etc.
- Optimize and tune PySpark jobs for performance and reliability
- Document data engineering processes workflows and best practices
- Strong understanding of databases data modelling and ETL tools and processes
- String programming skills in python and proficiency with PySpark SQL
- Experience with relational databases Spark AWS Python skill
- Excellent communication and collaboration skills
Key Responsibilities:
- Design and Development: Create develop and maintain robust solutions using PySpark to handle largescale data processing.
- Data Quality Assurance: Implement thorough testing validation and cleansing processes to ensure data quality and integrity.
- Data Integration: Integrate data from diverse sources including databases APIs and external datasets to create unified data solutions.
- Performance Optimization: Optimize and tune PySpark jobs for maximum performance and reliability.
- Documentation: Document data engineering processes workflows and best practices to enhance team collaboration and knowledge sharing.
- Database Management: Utilize strong understanding of databases data modeling and ETL processes to support data architecture needs.
- Programming Expertise: Leverage programming skills in Python and proficiency with SQL and PySpark for effective data manipulation and analysis.
- Collaboration: Work closely with crossfunctional teams to understand data requirements and deliver solutions that meet business needs.
aws,database management,api,python,data modeling,sql,databases,pyspark
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
