Designation: Lead Azure Data Engineer
Experience: 7 10 Years
Working Days: 5 Days
Location: Hyderabad
Notice Period: Immediate or 15 days maximum.
Requirements
Job Description:
- Good communication skills both written and verbal in English.
- Knowledge of Kimball SCD Type 1 and Type 2 and when to use it.
- Expert in building data pipelines on azure data factory Azure data bricks. Should have the ability to write complex SQL queries.
- Experience in writing Python & pyspark code. Good to have experience in creating the pipeline to read the data from the Streaming sources (Kafka).
- Knowledge on change data capture.
- Good experience in ADB.
- Azure Data Factory
- Parametrization and reusable linked services datasets and pipelines
- Selfhosted IRs
- Databricks
- DELTA LIVE Tables with time travel experience
- Structured LIVE streaming with DELTA LIVE Tables
- Knowledge of Optimization and partition best practices.
- Knowledge of how to use the Unity Catalog and its benefits.
- Mounting Technique.
- Streaming Data
- KAFKA KAFKA Connectors (Debezium MYSQL)
- Ideally knowledge of Confluent Kafka.
Event hubs service bus Azure Function.
Benefits
About Veltris
Where Innovation Acceleration and Transformation meet to deliver highROI
technology and business solutions.
Our design thinking approach to agile software development coupled with premium
fullstack capabilities and a cuttingedge innovation mindset accelerates timetomarket. This results in longterm strategic and competitive advantages for our clients
and partners.
Veltris Innovate Accelerate Transform to enable technologydriven Enterprise
Business and Industry transformations.
Roles & Responsibilities: A bachelor s degree in computer science (or a related field). Relevant certifications, such as Cisco Certified Network Professional (CCNP). Knowledge of network protocols, including TCP/IP, DNS, and DHCP. Experience with network hardware (routers, switches, and firewalls) Familiarity with network monitoring and management tools. Strong communication and teamwork abilities. Proficiency in network hardware and software configuration. Strong analytical and problem-solving abilities. Proficiency to work both independently and in a team setting. Time management and organizational skills. Adaptability and willingness to learn new technologies.