Data Engineer II
Data Engineer II
Posted on :
27-12-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Overview:
TekWissen is a global workforce management provider headquartered in Ann Arbor Michigan that offers strategic talent solutions to our clients worldwide. Our client is a company operating a marketplace for consumers sellers and content creators. It offers merchandise and content purchased for resale from vendors and those offered by thirdparty sellers.
Job Title: Data Engineer II
Location: Austin TX 78758
Duration: 12 Months
Job Type: Contract
Work Type: Onsite
Job Description:
- The client Security is looking for a Senior Data Engineer to join a team of highly skilled individuals working on our initiatives in resource and application discovery within the client security.
- Our product Veritas is a foundational service within the security that provides data for security initiatives like security reviews threat modeling and detection access control and incident response.
- You will work closely with a diverse range of roles such as Software Development Engineers Data Scientist Data Engineers Technical Program Managers Product managers and our Security Engineer customers to build high quality datasets for security investigations application modeling and more.
- Youll mostly work with AWS services like EMR Glue Athena Redshift S3 SNS SQS Airflow and some internal tools.
- Our lake comprises over 500 datasets from different sources with some datasets experiencing large daily volumes exceeding 1TB.
- You will be gathering and understanding data requirements partnering with software engineers and collaborating across roles and teams to create the necessary data infrastructure and high quality pipelines to drive our teams initiatives.
- We have highvisibility data ingestion goals in a fastpaced operational environment.
- The ideal candidate should enjoy the challenge of operating complex and missioncritical systems under extreme loads.
Typical Day in the Role:
- As a Data Engineer you will be working in one of the worlds largest and most complex data warehouse environments.
- You will understand and analyse business processes logical data models and relational database implementations.
- You will independently build endtoend data pipelines to ingest and transform data from different types of data sources and systems
- You will be responsible for designing and implementing a platform using AWS Data engineering tools modeling the tables.
- You will write high performing and optimized SQL queries
- You will continually improve the data quality and operations via automation and building full CI/CD data pipelines
- You will work with business customers in understanding the business requirements and implementing solutions to support analytical.
Candidate Requirements:
Client Leadership Principles:
- Bias for Action
- Dive Deep
- Deliver Results
Required Skills & Experience
- 46 years of related experience.
- Recognize and adopt best practices in data integrity data model testing analysis validation and documentation.
- A good candidate has strong analytical skills and enjoys working with large complex data sets.
- A good candidate can partner with business owners directly to understand their requirements and provide data which can help them observe patterns and spot anomalies.
Preferred:
- Neo4j Graph
Top 3 musthave hard skills
- Excellent knowledge of SQL
- Developing complex data model
- Evaluate and implement various bigdata technologies and solutions (e.g. Redshift Hive/EMR Spark SNS SQS Kinesis) to optimize processing of extremely large datasets
TekWissen Group is an equal opportunity employer supporting workforce diversity.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
