Location CHN BLR HYD (Pune/Delhi NCR)
Key skills Pyspark SQL & GCP (Big query & Data proc)
Experience 4 years only
About the role:
We are looking for a Senior Data Engineer to be based out of our Chennai office. This role involves a combination of handson contribution customer engagement and technical team management.
As a Senior Data Engineer you will
Design and build solutions for near realtime stream processing as well as batch processing on the Big Data platform.
Set up and run Hadoop development frameworks.
Collaborate with a team of business domain experts data scientists and application developers to identify relevant data for analysis and develop the Big Data solution.
Explore and learn new technologies for creative business problemsolving.
Required Experience Skills & Competencies:
Ability to develop and manage scalable Hadoop cluster environments
Ability to design solutions for Big Data applications
Experience in Big Data technologies like HDFS Hadoop Hive Yarn Pig HBase Sqoop Flume etc
Working experience on Big Data services in a GCP cloudbased environment.
Experience in Spark Pyspark Python or Scala Kafka Akka core or advanced Java and Databricks
Knowledge of how to create and debug Hadoop and Spark jobs
Experience in NoSQL technologies like HBase Cassandra MongoDB Cloudera or Hortonworks Hadoop distribution
Familiar with data warehousing concepts distributed systems data pipelines and ETL
Familiar with data visualization tools like Tableau
Good communication and interpersonal skills
Minimum 48 years of Professional experience with 3 years of Big Data project experience
B.Tech/B.E from reputed institute preferred