Big Data Engineer
Big Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Responsibilities
- Vanguards Trading Analytics & Strategy (TAS) team leverages data execution technology and research to advance vanguards trading strategies empowering traders to achieve the lowest trading costs unmatched efficiency and increased competitiveness.
- As an Engineer on the full stack team you will be expected to help design implement and maintain a modern robust and scalable platform which will enable the TAS team to meet the increasing demands from the various trading desks.
Qualifications:
- Proficiency in Python programming Strong expertise in SQL Presto HIVE and Spark
- Experience in big data technologies such as Spark and developing distributed computing applications using PySpark
- Experience with libraries for data manipulation and analysis such as Pandas Polars and NumPy
- Understanding of data pipelines ETL processes and data warehousing concepts
- Strong experience in building and orchestrating data pipelines
- Experience in building APIs
- Experience in designing and building web environments on AWS
- Write maintain and execute automated unit tests using Python
- Follow TestDriven Development (TDD) practices in all stages of software development
- Proficiency in data visualization tools and ability to create visual representations of data particularly using Tableau
- Extensive experience with key AWS services/components including EMR Lambda Glue ETL Step Functions S3 ECS Kinesis IAM RDS PostgreSQL Dynamodb Timeseries database CloudWatch Events/Event Bridge Athena SNS SQS and VPC
- Proficiency in developing serverless architectures using AWS services
- Experience with both relational and NoSQL databases
- Skills in designing and implementing data models including normalization denormalization and schema design
- Knowledge of data warehousing solutions like Amazon Redshift
- Strong analytical skills with the ability to troubleshoot data issues
- Good understanding of source control unit testing testdriven development and CI/CD
- Ability to write clean maintainable code and comprehend code written by others
- Strong communication skills
- Knowledge of trading and investment data
- Experience with OneTick / KDB
Required Skills : AWS Cloud FormationPythonSQL
Basic Qualification :
Additional Skills : AWS EngineerApplications ArchitectData Warehouse Engineer
Background Check : No
Drug Screen : No
Employment Type
Full Time
