Big Data Engineer
Posted on :
11-03-2024
Employer Active
1 Vacancy
The job posting is outdated and position may be filled
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Job Title: Big Data Engineer
Experience Required: 3 years postcollege
Location: Remote ( MUST be comfortable with working in Eastern Time (USA) )
Budget:USD per month
Position Overview:
We are seeking a dynamic and versatile Big Data Engineer to drive the efficiency of our Data Scientists and Engineering team. The successful candidate will play a pivotal role in constructing robust frameworks utilizing an array of tools and techniques including SQL Python R Java and C. Proficiency in machine learning techniques will be essential for crafting and maintaining data analysis structures while ensuring alignment with prevailing programming and deployment methodologies. Collaboration with colleagues is key throughout the process to ensure project needs are met effectively.
Key Responsibilities:
- Collaborate with team members and clients to elucidate project requirements.
- Develop infrastructure for accessing and analyzing big data efficiently.
- Optimize existing frameworks to enhance performance.
- Conduct thorough testing to validate the functionality of developed structures.
- Construct data pipelines from diverse sources utilizing varied data types (e.g. API CSV JSON).
- Prepare raw data for manipulation by Data Scientists.
- Implement robust data validation and reconciliation methodologies.
- Ensure data backups and accessibility for relevant stakeholders.
- Stay abreast of industry standards and technological advancements to enhance work quality.
Qualifications:
- Bachelors degree in Data Engineering Big Data Analytics Computer Engineering or related field.
- Masters degree in a relevant field is preferred.
- Proficient in airflow
- 3 years of experience in Python Java or any programming language development.
- 3 years of experience with SQL & NoSQL databases (experience with Snowflake Cloud DW & MongoDB is advantageous).
- Proficient in schema design and dimensional data modeling.
- Expertise in SQL NoSQL Python C Java and R.
- Experience in building Data Lakes Data Warehouses or equivalent solutions.
- Proficiency in AWS Cloud services.
- Strong analytical and problemsolving abilities.
- Ability to work independently and collaboratively within a team.
- Effective management of multiple tasks with minimal supervision.
If you are passionate about leveraging cuttingedge technology to drive innovation in the cryptocurrency investment space we encourage you to apply and be part of our dynamic team dedicated to revolutionizing the industry.
MUST be comfortable with working in Eastern Time (USA)
Notice Period: Immediate joiner to max 15 days
big data,airflow,python,sql,aws
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
