Principal Data Platform Engineer

WaferWire is looking for Principal Data Platform Engineer for a client in CA (Remote Opportunity)

Role: Principal Data Platform Engineer

Job Description:

Summary

This is an exciting opportunity for an experienced senior developer of large scale data solutions. You will join a team delivering a transformative next-gen cloud hosted data platform.

The ideal candidate will have a proven track record in implementing real-time event data streaming, NoSQL data stores and transformation pipelines for large scale organizations. We are seeking someone with deep technical skills in a variety of technologies to play an important role in developing and
delivering early proofs of concept and production implementation. The successful candidate will have hands-on experience in a multitude of data domains; including, but not limited to; 24 x 7 x 365 enterprise and cloud database infrastructure design and management, security, database design, database development, database tuning, service delivery, incident tracking, and change management.

Responsibilities

• Executes design sessions to gather requirements, review, approve, and communicate design artifacts with stakeholders
• Designing and implementing performance data movement pipelines using real-time event data streams (Apache Kafka, Azure Event Hub, AWS Kinesis, etc)
• Architecting and managing various data model associated with NoSQL DBs (Azure Cosmos, MongoDB, Cassandra, etc) and Relational DBs (MS SQL Server, PostgreSQL, Oracle, etc)
• Ensures database features and capabilities are
  incorporated into data model designs to optimize performance, resiliency and scalability.
• Establishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and security policy.
• Documents and communicates database design. Evaluates and installs database management systems.
• Codes complex programs and derives logical processes on technical platforms.
• Delivering and presenting proofs of concept to of key technology components to project stakeholders and internal technology leaders
• Developing scalable and re-usable frameworks for ingestion of structured and semi-structured data
• Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
• Working with other members of the project team to support delivery of additional project components associated with cloud data platform.
• Perform problem-solving of application issues and production errors, including high level critical production issues that require immediate attention
• Perform other duties as assigned

Qualifications

• Bachelors degree in Computer Science or Engineering required. Masters degree preferred.
• 7+ years of overall software development and/or database engineering experience required
• 2+ years of hands-on development experience with event based streaming technologies (Apache Kafka / Azure Event
  Hub or similar)
• 2+ years of hands-on development Experience with NoSQL DBs (MongoDB/Cassandra/ Azure Cosmos DB or similar)
• Strong knowledge and experience in data modeling & design with relational and NoSQL DBs
• Demonstrated expertise in performance tuning in various DB environments
• Experience building and scaling distributed, highly available systems in cloud env (Azure / AWS)
  
• Expertise in understanding complex business needs, analyzing, designing, and developing solutions
• Communication and professional skills and the ability to establish relationships across business units
• Experience working in a Dev/Ops environment with tools such as Microsoft Visual Studio Team Services, Chef, Puppet or Terraform

Pluses

• Financial technology domain knowledge
  
• Knowledge of SQL Server including T-SQL, the writing of complex stored procedures, optimization for performance, and SSIS packages
• Experience with .NET, MVC, C# HTML5 CSS3 AJAX jQuery IIS and Java script
• Microsoft Azure Data Engineer or other cloud certifications