Data Engineer

What Youll Do:

Manage ingest and ETL/ELT pipelines for many different massive data sources (terabytes of

structured and unstructured datasets spanning music video games sports and more to come)

Define schemas partitions and indexes appropriate to usage

Create custom views and tune application queries

Ensure completeness and usefulness of data sets for teammates and external customers

Implement solutions to proactively monitor data quality with traceability to source systems

Gather requirements from key stakeholders conduct gap analyses and create user requirement documentations

What Youll Bring:

35 years of solid experience with relational databases and object stores

Bachelors Degree in computer science engineering mathematics or related fields or equivalent relevant experience

Strong SQL chops understanding of tuning and partitioning techniques

Deep knowledge of ETL pipelines with a focus on data quality control and tracking

Proven expertise with data wrangling cleaning and tagging

Python and shell scripting skills a must

Transforming JSON and unstructured data to/from APIs a must

Docker/Kubernetes and DAGs a big plus

Advanced knowledge of AWS toolkit and alternatives a big plus

Experience with data security compliance identity and access management

Strong written and verbal technical communication skills with an ability to present complex technical information clearly and concisely to a variety of audiences

Passion for driving change and ability to adapt to change quickly