Data Engineer
Data Engineer
Posted on :
31-10-2024
Employer Active
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Title: Data Engineer
Location: 12 months
Location: 12 months
Responsibilities
- Design develop and optimize ETL processes to ingest and process data from diverse sources efficiently and reliably.
- Collaborate with data scientists analysts and crossfunctional teams to design data models that support analytics and reporting.
- Ensure data pipeline efficiency scalability and data reliability through continuous monitoring troubleshooting and optimization.
- Integrate and transform data from multiple sources into unified datasets ensuring quality and integrity.
- Implement best practices in data quality security and governance adhering to compliance standards.
- Conduct system performance tuning data validation and error handling.
- Work with crossfunctional teams to understand data requirements and develop datadriven solutions.
- Set up monitoring and alerts for data pipelines manage error handling and establish recovery mechanisms.
- 5 years of experience in data engineering or related fields with a focus on largescale data infrastructure.
- Strong programming skills in Python Java Scala or a similar language.
- Handson experience with big data technologies like Apache Spark Hadoop or Kafka.
- Proficiency in SQL databases (e.g. PostgreSQL MySQL) and NoSQL databases (e.g. MongoDB Cassandra).
- Experience with cloudbased data warehousing solutions like Amazon Redshift Snowflake or Google BigQuery.
- Familiarity with cloud environments particularly AWS Azure or Google Cloud.
- Knowledge of ETL and data orchestration tools such as Apache Airflow Prefect or Talend.
- Strong problemsolving skills and attention to detail with an ability to understand complex data requirements.
- Excellent communication skills to work effectively with team members and stakeholders.
- Bachelors or Masters degree in Computer Science Engineering Data Science or a related field.
- Relevant certifications in data engineering or cloud platforms (e.g. AWS Certified Big Data Specialty).
Thanks & Regards!
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
