Data Engineer Databricks Python Pyspark
Data Engineer Databricks Python Pyspark
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Role name: Engineer
Role Description:
1. Senior/Lead developer position who has extensive experience with development/design in Azure Databricks (language :Scala) experience.
2. The candidate should have strong experience in either Databricks or Snowflake however Databricks knowledge is must
3. The candidate should have extensive experience in the data engineering
4. The candidate should have good experience in Scala programming language for data bricks development(He should have done the end to end data ingestion and data transformation in Databricks/snowflake).
5. Candidate should have strong experience in the Data warehousing (ETL Concepts Types of SCD)
6. Candidate should have very good experience in the data lakeand delta tables concepts.
7. Candidate should have experience in databases like SQL server/Oracle
8. If Candidate have bigdata hadoop experience will be added advantage.
Willing to work out of Quincy MA Prior experience with migrations from SQLSERVER/ORACLE to Databricks Familiarity with multiple source systems database Need strong experience in Data ingestion and Data transformation in azure Databricks Expecting very good knowledge in datawarehousing concepts in Azure Databricks Capablity to migrate data from multiple data source to data bricks.
Strong coding knowledge in scala language Should have a experience in Spark sql Any other etl experience is preferable TSQL /PLSQL Experience writing functions complex queriesStrong communication skills
Strong experience with implementing delta lake houses on Azure Databricks using medallion architecture (Bronze Silver Gold)
Employment Type
Full Time
