Data Engineer

Senior Data Engineer

Essential Duties and Responsibilities:

• Responsible for designing and building systems to collect and process data (and events) at massive scale. The data is used for a variety of purposes from business insights to application(s) monitoring.
  
• Conducts and coordinates the design and implementation of software development to meet user requirements.
  
• Performs quality assurance activities such as peer reviews.
  
• Support Operations and Maintenance (O&M) tasks for all application programs and assist with analyzing and troubleshooting production issues.
  
• Analyze business requirements and create technical specifications develops unit test plans to verify functionality of new and or revised applications.
  
• Develops technical design specifications for application development.
  
• Guides the work of Junior and Journeyman Data Engineers
  

Work Experience:

• A Minimum 6 years of experience in complete software development lifecycle using Agile methodologies
  
• Experience with at least one of the following technologies:
  

• Batch and distributed stream processing methods such as Apache Spark and Kafka
  
• Distributed NoSQL/KeyValue stores such as HBase Cassandra or DynamoDB
  
• Distributed search engines like Elasticsearch or Solr
  

• Restful web services experience with code development deployment versioning and build tools (e.g. Eclipse Git Gradle Maven Jenkins)
  
• Understanding of Microservices architecture including professional experience in the design build and operations of micro services in a production environment
  
• 5 years of experience with Relational Database Systems and SQL
  
• 3 years of experience with UNIX/Linux and shell scripting
  
• 1 years of experience developing containerized applications using Docker Docker Swarm Kubernetes
  
• Experience delivering solutions using Amazon Web Services (AWS EC2 RDS S3 VPC)
  

Requirements

Job Skills:

• Knowledge and experience in software development with the identified technologies
  
• Knowledge and experience in Microsoft Office including Excel Office etc.
  
• Comprehensive problemsolving skills with exceptional attention to detail
  
• Willingness to learn evolve and multitask.
  

Education:

• Bachelors Degree in Computer Science Information Systems Engineering or other related discipline required
  

Certificates Licenses & Registrations:

• US citizens only due to federal/government requirement.
  
• Must be able to clear U.S. Customs and Border Protection Background Investigation (BI)
  
• Existing Customs and Border Protection BI desired
  

Benefits