Job role: Junior Data Scientist
Duration: 6month contract
Location: Monday Thursday inoffice in Brooklyn NY Friday remote
Current State:
- Currently they are partnering with an engineering firm Agilitech to provide monthly engineering hours.
- Looking to bring more inhouse engineering expertise to complement existing efforts.
- Data Analytics and Insights report directly to the Chief Digital Officer.
- Focus areas include Advanced Analytics Insights Business Intelligence (BI) and Data Science.
- The data warehouse has grown significantly and the team is scaling to build more reports and support expansion.
Technology Stack:
- AWS: Most data resides in S3 buckets with EventBridge handling processing and Postgres RDS as the primary database.
- Data comes from external sources (e.g. Ticketmaster Salesforce) and is ingested into S3 processed via EventBridge and stored in Postgres with DBT for transformation.
- Recently signed a contract with Snowflake for migration efforts.
- Need to optimize RDS which is nearing capacity and implement best practices for query optimization.
- Heavy ETL work using AWS Glue Jobs Snowflake exposure and RDS.
- Focus on building endtoend pipelines regression testing and implementing effective ETL frameworks.
Team Dynamics:
- A young and aspiring team with many BI Analysts eager to grow into more technical roles.