Company Overview:
Nilasu Consulting Services Pvt Ltd is a leading company in the human resources industry providing innovative solutions for businesses of all sizes. With a commitment to excellence and a focus on client satisfaction Nilasu Consulting Services offers a wide range of services including talent acquisition workforce planning and HR consulting.
Role and Responsibilities:
As a Lead Azure DE you will be responsible for designing implementing and maintaining efficient data engineering solutions using Azure technologies. Your main responsibilities will include:
- Building and managing data pipelines using Azure Data Factory (ADF)
- Utilizing Azure Databricks for data engineering tasks such as data ingestion transformation and analysis
- Working with Oracle Database for data storage retrieval and manipulation
- Writing complex SQL queries for data processing and analysis
- Implementing Continuous Integration and Continuous Deployment (CI/CD) pipelines for data engineering solutions using Azure DevOps
- Monitoring the performance of data engineering solutions and optimizing them for better efficiency
- Ensuring data quality and performing data cleaning operations to maintain reliable data
- Employing data modeling techniques and ETL/ELT processes for data integration
- Having knowledge of Apache Hive a data warehousing and SQLlike query language
- Understanding Apache Spark and its various components
Candidate Qualifications:
To be considered for the role of Lead Azure DE you should meet the following qualifications:
- Bachelor s degree in Computer Science Computer Engineering or related technical discipline
- Minimum 45 years of experience working in ETL projects
Required Skills:
- Azure Data Factory (ADF)
- Azure Databricks
- Oracle Database
- Strong SQL programming
- Python / PySpark
Work Schedule:
The working hours for this position are from 2 PM to 11 PM.
monitoring and optimization,apache spark,data quality and data cleaning,data modeling and etl/elt,python,apache hive,adb,azure databricks,sql programming,oracle database,azure devops,adf,python / pyspark,azure data factory (adf)