Currently we are looking for Lead Databricks/Pyspark Developer.
Responsibilities
Position Lead Databricks/Pyspark Developer.
Exp 7Yrs
Notice Immediate to 30 Days
Location Hyderabadchennai (Hybrid)
JD
Design and development of data ingestion pipelines (Databricks background preferred).
Performance tune and optimize the databricks jobs
Evaluated new features and refractors existing code
Mentor junior developers and makes sure all patterns are documented
Perform data migration and conversion activities.
Develop and integrate software applications using suitable development methodologies and standards applying standard architectural patterns taking into account critical performance characteristics and security measures.
Collaborate with Business Analysts Architects and Senior Developers to establish the physical application framework (e.g. libraries modules execution environments).
Minimum Qualifications and Job Requirements:
* Must be a team player.
Must have following:
SCALA
SQL
Spark/Spark Streaming
Big Data Tool Set
Linux
Python/PySpark
Kafka
* Experience collaborating with dev team project managers and engineers.
* Excellent communication and teamwork skills
Qualifications
Any Gradation fine.
scala,sql,spark,big data,linux,python,kafka