Overview:
The Data Engineer plays a crucial role in the organization responsible for designing developing and maintaining the data infrastructure. They ensure the availability reliability and efficiency of data systems enabling the organization to make datadriven decisions and deliver highquality products and services to clients.
Key Responsibilities:
- Designing and implementing scalable data pipelines for ingesting transforming and storing large volumes of data.
- Building and maintaining data warehouses and data lakes for analytics and reporting purposes.
- Developing ETL processes to transform raw data into valuable insights for business stakeholders.
- Collaborating with data scientists to deploy machine learning models into production environments.
- Optimizing database performance and ensuring data security and compliance.
- Automating datarelated processes and monitoring system health and performance.
- Creating and maintaining documentation for data infrastructure and processes.
- Collaborating with crossfunctional teams to understand data requirements and deliver solutions.
- Keeping uptodate with industry best practices and emerging technologies in data engineering.
Required Qualifications:
The skills we are looking for are:
- Strong handson experience on designing and developing DWH applications.
- Strong handson experience on one of the query languages like SQL PL/SQL. Snow SQL DBT (preferred) etc.
- Good exposure to cloud based Datawarehouse like Snowflake.
- Exposure to reporting tools like Tableau Power BI is nice to have.
- Good communication skills and experience working with global teams.
- Exposure to at least one of standard code management tools like GitHUb Git Lab TFS etc.
- Knowledge of Python DataFrames and Streamlit is nice to have.
sql,data modeling,etl,big data,data warehousing,data analysis,snowflake