Lead Big Data Engineer
Lead Big Data Engineer
Posted on :
31-08-2024
Employer Active
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Monthly Salary
Not Disclosed
Salary Not Disclosed
Posted on :
31-08-2024
Job Description
Position Information
Type: C2C
Title: Lead Big Data Engineer
Location Type: Chicago IL (Onsite)
Job Description:
- Need an experienced and seasoned professional big data engineer greater than 12 14 years of experience in AWS and other tech stack listed below:
- Understand customer requirements and render those as architectural models that will operate at large scale and at high performance
- Create and validate the prepared architecture patterns validate them against nonfunctional requirements and finalize the build model.
- Should be able to present their point of view on different big data architectural patterns.
- Experience in creating architectural proposals.
- Must have experience in leading teams and interacting with clients to gather requirements.
- Must have led a team of developers with diverse skillset (Big Data Reporting and Database architecture).
- Experience with Statistics Machine Learning and Predictive Modelling.
- Work alongside customers to build data management platforms using Elastic Map Reduce (EMR) Redshift Kinesis Amazon Machine Learning
- Amazon Athena Lake Formation S3 AWS Glue DynamoDB ElastiCache and the Relational Database Service (RDS)
- Well experience on other AWS services EC2 EMR Redshift S3 Streaming services like Kafka Kinesis HDFS.
- Experience with Starburst ecosystem.
- Experience with developing data models in Data Build Tool (dbt).
- Experience with configuration based ETL pipeline development.
- Experience with Dagster as an orchestration too.
- Render working high performance data management solutions as CloudFormation and reusable artifacts for
- Implementation by the customer. Bootstrap using user data scripts will be added advantage
- Implementation and tuning experience in the Big Data Ecosystem (such as EMR Hadoop Spark R Presto Hive)
- Database (such as Oracle MySQL PostgreSQL MS SQL Server) NoSQL (such as DynamoDB HBase MongoDB Cassandra
- design principles) and Data Warehousing (such as Redshift Teradata Vertica schema design query tuning and optimization) and data migration and integration.
- Track record of implementing AWS services in a variety of business environments such as large enterprises and startups.
- Knowledge of foundation infrastructure requirements such as Networking Storage and Hardware Optimization.
- Prepare architecture and design briefs that outline the key features and decision points of the application built in the Data Lab
- Work with customers to advise on changes as they put these systems live on AWS 25. Extract bestpractice knowledge reference architectures and patterns from these engagements for sharing with the worldwide AWS solution architect community
- AWS Certification eg. AWS Solutions Architect AWS Developer or AWS Certified Big Data Specialty (Data Analytics Specialty)
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
