Data Engineer - Data bricks
Data Engineer - Data bricks
Posted on :
28-12-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Position: Data Engineer with Data bricks Exp.
Location: Plano TX
Onsite
Duration: Long Term
Location: Plano TX
Onsite
Duration: Long Term
Must Have:
- Min 12 years of experience with strong exp in Data bricks and Coding
What you will do:
- Implemented scalable cloud architectures for enterprise applications using AWS services for Data platforms
- Develops and maintains CI/CD pipelines to automate deployment processes and ensure continuous integration.
- Leads teams in designing and developing centralized data warehouses and data lakes. Preferably using redshift
- Creates and optimizes ETL processes to ingest and transform large datasets for analytical purposes.
- Utilizes Apache Airflow for scheduling and monitoring data workflows to ensure timely data delivery.
- Implements data partitioning compression strategies and query optimization techniques.
- Develops serverless applications using AWS Lambda and API Gateway to reduce operational costs.
- Automates configuration management using tools like Ansible and Terraform.
- Conducts security assessments and implemented IAM and VPC best practices to secure cloud environments.
- Integrated monitoring and logging solutions using CloudWatch Prometheus and ELK Stack for performance and security monitoring.Created automated reporting solutions and interactive dashboards using Tableau Looker and Power BI.
- Conducts data quality checks and ensured data integrity across multiple data pipelines.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
