Senior Data Engineer
Senior Data Engineer
Posted on :
26-11-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
This is a remote position.
As a Senior Data Engineer you will be responsible for designing implementing and maintaining robust data infrastructure solutions and a complex ETL which drives our core business operations. You will work closely with our team to ensure the efficient and effective processing of large datasets. Your expertise in SQL and ETL processes will be crucial in shaping our data strategy.
Responsibilties:
- Database Design and Implementation: Architect scalable and highperformance data solutions to process millions of rows of data.
- ETL Development: Design implement and manage ETL pipelines to support data integration and transformation processes.
- Data Modeling: Develop and maintain complex data models and database schemas to support various business needs.
- Tool Integration: Utilize tools like DBT and Prefect (or similar) to streamline data workflows and ensure data quality.
- Collaboration: Work closely with company stakeholders & engineers to understand data requirements deliver solutions and collaborate crossfunctionally.
- Documentation: Document core data processes using industry standard best practices.
- Performance Tuning: Optimize database performance and ensure efficient query execution.
Requirements
- Experience: Minimum of 5 years of experience in data engineering or software engineering.
- SQL: Mastery of SQL with a strong ability to write and optimize complex queries and stored procedures.
- Python: Strong programming skills using python or other OO programming language.
- DBT: Handson experience with DBT (Data Build Tool) for data transformation and modeling.
- ETL Skills: Proven experience in designing and implementing robust ETL processes.
Nice to Haves:
- Automated Testing: Experience writing and devloping unit or E2E tests for data pipelines and/or python backends.
- Prefect: Experience building data pipelines with Prefect or other similar ETL tools.
- DevOps Experience: Familiarity with DevOps practices and tools to manage and deploy data solutions.
- Web Development: General familiarity with PHP / Javascript / HTML / CSS.
Benefits
- Work Location: Remote
- 5 days working
Experience: Minimum of 5 years of experience in data engineering or software engineering. SQL: Mastery of SQL with a strong ability to write and optimize complex queries and stored procedures. Python: Strong programming skills using python or other OO programming language. DBT: Hands-on experience with DBT (Data Build Tool) for data transformation and modeling. ETL Skills: Proven experience in designing and implementing robust ETL processes.
Education
Bachelor's degree in Computer Science, Engineering, or related field (or equivalent work experience)
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
