Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Project description
As a DataEngineer in the Data Engineering & Analytics team you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores restaurants banks and other consumerfocused companies. The challenge will be to create highperformance algorithms cuttingedge analytical techniques including machine learning and artificial intelligence and intuitive workflows that allow our users to derive insights from big data that in turn drive their businesses. You will have the opportunity to create highperformance analytic solutions based on data sets measured in the billions of transactions and frontend visualizations to unleash the value of big data. You will have the opportunity to develop datadriven innovative analytical solutions and identify opportunities to support business and client needs in a quantitative manner and facilitate informed recommendations/decisions through activities like building ML models automated data pipelines designing data architecture/schema performing jobs in big data cluster by using different execution engines and program languages such as Hive/Impala Python Java Kafka Spark R etc.
Skills Must have:
- Bachelors degree in Computer Science Engineering Mathematics or a related field
- Proven experience as a machine learning engineer working on complex machine learning projects
- Strong programming skills in languages like Python R or similar
- Solid understanding of machine learning algorithms deep learning frameworks and statistical modeling techniques
- Handson experience with machine learning libraries such as TensorFlow PyTorch or scikitlearn
- Proficiency in data preprocessing feature engineering and data visualization
- Experience with cloud platforms such as AWS Azure or GCP for deploying machine learning models
- Familiarity with version control systems (e.g. Git) and collaborative development practices
- Strong problemsolving skills and ability to troubleshoot and optimize machine learning models
- Excellent communication skills to convey technical concepts to both technical and nontechnical stakeholders
- Proven ability to work in a collaborative team environment and drive projects to completion Ideal Candidate Qualifications:
- Working proficiency in using Python/Scala Spark (tuning jobs) SQL Hadoop platforms to build Big Data products & platforms.
- Good programming skills in Java and spring boot and Junit.
- Knowledge in software development test approaches & frameworks
- Familiarity with RESTful APIs and microservices architectures
- Experience in working with CI/CD
- Experience in working with SQL database like Postgres Oracle
- Preferably with handson experience with Hadoop big data tools (Hive Impala Spark)
- Experience with data pipeline and workflow management tools: NIFI Airflow.
- Comfortable in developing shell scripts for automation.
- Good troubleshooting and debugging skills.
- Proficient in standard software development such as version control testing and deployment
- Demonstrated basic knowledge of statistical analytical techniques coding and data engineering
- Ability to quickly learn and implement new technologies
- Ability to Solve complex problems with multilayered data sets
- Ability to innovate and determine new approaches & technologies to solve business problems and generate business insights & recommendations.
- Ability to multitask and strong attention to detail
- Flexibility to work as a member of a matrix based diverse and geographically distributed project teams
Nice to have
Experience with performance Tuning of Database Schemas Databases SQL ETL Jobs and related scripts
Experience in working with Cloud APIs (e.g. Azure AWS)
Experience participating in complex engineering projects in an Agile setting e.g. Scrum
Employment Type
Full Time
