Overview:
The Data Engineer (AWS/Power Platform) plays a crucial role in our organizations data infrastructure ensuring the efficient design development and maintenance of data pipelines to facilitate data processing analytical insights and business intelligence applications.
Key Responsibilities:
- Design build and maintain scalable reliable data pipelines on AWS and Power Platform.
- Collaborate with data scientists and analysts to understand data requirements and develop appropriate solutions.
- Implement data models and ETL processes for structured and unstructured data sources.
- Optimize and maintain databases data lakes and data warehouses.
- Ensure data quality and integrity through data validation and cleansing processes.
- Develop and manage realtime and batch data processing solutions.
- Implement security and compliance measures in data storage and processing.
- Provide technical expertise in data visualization and reporting tools.
- Conduct performance tuning and optimization of data solutions.
- Document data processes pipelines and architecture.
Required Qualifications:
- Bachelors or Masters degree in Computer Science Engineering or related field.
- Strong experience in data modeling ETL and data warehousing.
- Proficiency in AWS services such as S3 Redshift Glue and EC2.
- Experience with Microsoft Power Platform including Power BI and Power Query.
- Expertise in SQL NoSQL databases and data query languages.
- Familiarity with cloudbased data solutions and serverless architectures.
- Proven ability to work with largescale data processing frameworks.
- Understanding of data governance security and privacy regulations.
- Excellent problemsolving and analytical skills.
- Strong communication and collaboration abilities.
analytical skills,data pipelines,data query languages,security,nosql databases,data warehousing,serverless architectures,etl,power platform,data processing,privacy regulations,problem-solving,communication,data modeling,data engineering,aws,sql,collaboration,cloud-based data solutions,data governance