Senior Data Engineer USA based Hybrid
Senior Data Engineer USA based Hybrid
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Overview:
Key Responsibilities:
- Building data pipelines alerting and reporting for trade and blockchain data.
- Designing data pipelines and automating ETL processes and SQL optimization which will influence the next generation for ledger reconciliation processes and reporting.
- Partnering with teams throughout the organization for all types of data reconciliation both ad hoc and scheduled.
- Creating data validation processes customized reporting and investigating the underlying root cause for exception reports.
Required Qualifications:
- 5years implementing a reconciliation system while improving existing data pipelines.
- Experience building realtime data solutions and processes.
- Experience building and integrating web analytics solutions.
- Advanced SQL skills is a must.
- Experience and expertise in Databricks Spark Hadoop etc.
- Skilled in programming languages Python and/or Java.
- Experience with one or more MPP databases(Redshift Bigquery Snowflake etc).
- Able to identify gaps in existing reconciliation processes.
- Extensive ETL and database experience with financial transaction systems for (banking systems exchange systems).
- Experience with Datadog or other alert monitoring systems.
- Familiarity with reading and decoding FIX and REST messages.
- Financial certifications are not required but encouraged. Understanding the regulatory landscape in traditional financial markets will lend well as the digital asset space evolves.
- Financial Reporting Requirements for publicly traded companies.
financial certification,rest,data engineering,mpp databases,data modeling,bigquery,etl,spark,redshift,snowflake,sql,databricks,python,datadog,hadoop,fix,java,big data
Employment Type
Full Time
Company Industry
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
