Associate Principal Engineer Big Data Engineer
Associate Principal Engineer Big Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
REQUIREMENTS:
- Total experience 11 years.
- Excellent knowledge and experience in Big data engineer.
- Expertise in Databricks Azure Synapse Azure Data Factory and PySpark.
- Strong working experience with architecture and development in Azure cloud services such as ADF ADLS Azure SQL Logic Apps and Azure Functions.
- Strong handson experience in Databricks and related architecture like Medallion.
- Experience in implementing and delivering data solutions and pipelines on Databricks.
- A strong understanding of data modeling data structures data warehouses databases and ETL processes.
- An indepth understanding of largescale data sets including structured and unstructured data.
- Hands on experience in SQL.
- Should have a basic understanding of CI/CD and DevOps.
- Good to have GenAI experience
- Experience with building and maintaining a cloud system.
- Familiarity with data modeling data warehousing and building distributed systems.
- Expertise in Spanner for highavailability scalable database solutions.
- Knowledge of data governance and security practices in cloudbased environments.
- Problemsolving mindset with the ability to tackle complex data engineering challenges.
- Strong communication and teamwork skills with the ability to mentor and collaborate effectively.
RESPONSIBILITIES:
- Writing and reviewing great quality code.
- Understanding the clients business use cases and technical requirements and be able to convert them in to technical design which elegantly meets the requirements.
- Mapping decisions with requirements and be able to translate the same to developers.
- Identifying different solutions and being able to narrow down the best option that meets the clients requirements.
- Defining guidelines and benchmarks for NFR considerations during project implementation.
- Writing and reviewing design document explaining overall architecture framework and highlevel design of the application for the developers.
- Reviewing architecture and design on various aspects like extensibility scalability security design patterns user experience NFRs etc. and ensure that all relevant best practices are followed.
- Developing and designing the overall solution for defined functional and nonfunctional requirements; and defining technologies patterns and frameworks to materialize it.
- Understanding and relating technology integration scenarios and applying these learnings in projects.
- Resolving issues that are raised during code/review through exhaustive systematic analysis of the root cause and being able to justify the decision taken.
- Carrying out POCs to make sure that suggested design/technologies meet the requirements.
Qualifications :
Bachelors or masters degree in computer science Information Technology or a related field.
Remote Work :
Yes
Employment Type :
Fulltime
Employment Type
Remote
Company Industry
Department / Functional Area
Engineering
Key Skills
- Design
- Academics
- AutoCAD 3D
- Cafe
- Fabrication
- Java
