Data Engineer - Sr Consultant level-Scala or Python Hadoop Spark Hive Kafka 9 yrs experience
Data Engineer - Sr Consultant level-Scala or Python Hadoop Spark Hive Kafka 9 yrs experience
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
We value creative and driven individuals who love to own their products and design and implement solutions that create a seamless experience for consumers and clients. Our Data engineers work across the stack and are experts in building data driven business solutions using technologies such as Hadoop Hive Spark Scala Python MS SQL Kafka & Power BI. As we embark on the journey to build a Data Lake we are looking for a Senior Consultant Data Engineer who can drive architecture design and development activities.
The role involves extensive handson activities. Here are key job responsibilities
Responsible for the architecture design and development
Work on development of new products iteratively by building quick POCs and converting ideas into real products
Develop workflows and ETL/ELT code using Hive scripts Spark and other utilities on Hadoop.
Build analytical applications using Hadoop eco system using packaged or open source technologies
Build resilient data pipelines for reporting and data science/ML use cases
Interact with both business and technical stakeholders to deliver high quality products and services that meet business requirements and expectations while applying the latest available tools and technology
Have a passion for delivering zero defect code and be responsible for ensuring the teams deliverables meet or exceed the prescribed defect SLA
Present technical solutions capabilities considerations and features in business terms. Effectively communicate status issues and risks in a precise and timely manner.
Perform other tasks on R&D data governance data security system infrastructure and other cross team functions on an asneeded basis
This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 23 set days a week (determined by leadership/site) with a general guidepost of being in the office 50% or more of the time based on business needs.
Qualifications :
Basic Qualifications
9 years of relevant work experience with a Bachelors Degree or at least 5 years of experience with an Advanced Degree (e.g. Masters MBA JD MD) or 2 years of work experience with a PhD OR 11 years of relevant work experience.
Preferred Qualifications
Masters or Bachelor degree in Computer science or related fields required.
Minimum of 9 years of experience in building data driven business solutions and solving data problems
Minimum of 4 years of experience in building largescale data solutions using open source technologies. Design and coding skills with Big Data technologies like Hadoop Spark Hive Kafka
Minimum of 4 years of handson expertise with Java or Scala or Python
Experience with highly distributed scalable concurrent and low latency systems working with one or more of the following database technologies: DB2 MS SQL MySQL and NoSQL data warehouses such as HBase
Experience with Continuous Integration tools such as Jenkins Artifactory etc desirable
Experience with data visualization and business intelligence tools like Power BI is a plus
Experience with Databricks advantageous
Additional Information :
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
