Big Data Engineer
Big Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Title: Data Engineer
Position: SSE
Experience: 56yrs
Category: IT Infrastructure
Main location: India Karnataka Bangalore
Employment Type: Full Time
Primary skillData Engineer
Qualification: Bachelors degree in Computer Science or related field or higher.
Roles and Responsibilities
Data Engineer 56 years experience.
Responsibilities
Design develop and maintain data architectures pipelines and workflows for the collection processing storage and retrieval of large volumes of structured and unstructured data from multiple sources.
Collaborate with crossfunctional teams to identify and prioritize data engineering requirements and to develop and deploy datadriven solutions to address business challenges.
Build and maintain scalable data storage and retrieval systems (e.g. data lakes data warehouses databases) faulttolerant and highperformance data platforms on cloud infrastructure such as AWS Azure or Google Cloud Platform.
Develop and maintain ETL workflows data pipelines and data transformation processes to prepare data for machine learning and AI applications.
Implement and optimize distributed computing frameworks such as Hadoop Spark or Flink to support highperformance and scalable processing of large data sets.
Build and maintain monitoring alerting and logging systems to ensure the availability reliability and performance of data pipelines and data platforms.
Collaborate with Data Scientists and Machine Learning Engineers to deploy models on production environments and ensure their scalability reliability and accuracy.
Requirements:
Bachelor s or master s degree in computer science engineering or related field.
At least 56 years of experience in data engineering with a strong background in machine learning cloud computing and big data technologies.
Experience with at least one major cloud platform (AWS Azure GCP).
Proficiency in programming languages like Python Java and SQL.
Experience with distributed computing technologies such as Hadoop Spark and Kafka.
Familiarity with database technologies such as SQL NoSQL NewSQL.
Experience with data warehousing and ETL tools such as Redshift Snowflake or Airflow.
Strong problemsolving and analytical skills.
Excellent communication and teamwork skills.
Preferred qualification:
Experience with DevOps practices and tools such as Docker Kubernetes or Ansible Terraform.
Experience with data visualization tools such as Tableau Superset Power BI or Plotly D3.js.
Experience with stream processing frameworks such as Kafka Pulsar or Kinesis.
Experience with data governance data security and compliance.
Experience with software engineering best practices and methodologies such as Agile or Scrum.
Must Have Skills
data engineer with expertise in machine learning cloud computing and big data technologies.
Data Engineering Experince on multiple clouds one of them preferably GCP
data lakes data warehouses databases
ETL workflows data pipelinesdata platforms
Hadoop Spark or Flink
Hadoop Spark and Kafka
SQL NoSQL NewSQL
Redshift Snowflake or Airflow
Remote Work :
No
Employment Type
Full Time
