Big Data Software Engineer - W2 ONLY
Big Data Software Engineer - W2 ONLY
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Job Title: Software Engineer
Location: O Fallon MO 63366
Type: 6 months contract on W2
Description: Seeking a Software Engineer who thrives on designing coding and maintaining large data processing systems primarily in the Spark framework using Scala. Our ideal candidate will understand the challenges of working with data at scale and have a firm knowledge of algorithms and processing complexity. Our team is a mix of software engineers and data analysts working to ensure our inputs algorithms and publishing artifacts are of the highest quality and efficiency. Our output is critical to the accuracy of our Risk Analysis APIs which power top ecommerce sites.
Responsibilities:
-
Develop big data processing systems using Scala Apache Spark Airflow Databricks AWS and related technologies
-
Run our ingestion and publishing processes and debug problems when they occur
-
Follow SDLC and best practices for clean code and architecture
-
Impact system architecture and improve overall system efficiency with growing business needs
-
Deliver assigned work with guidance from experienced team members
-
Understand and follow standard branching (e.g. Gitflow) and peer review practices
-
Understand the big picture and endtoend logical architecture of systems in ownership areas
-
Provide feedback and suggestions on areas to improve
-
Understand requirement analysis being an essential part of delivering value to our customers and partners and participate in elaboration prioritization and effort estimation
-
Understand Continuous Integration (CI) and Delivery (CD) concepts and capabilities to support automation pipelines virtualization and containerization
-
Understand the use of Client technology policies in everyday work
-
Demonstrate active learning and sharing of software practices via Guild/Engineering community initiatives
Qualifications:
-
Selfmotivated learner willing to take on challenging problems
-
Aptitude to learn new languages and technologies as necessary
-
Ability to write clean readable and maintainable code that follows best practices
-
Passion for diving deep into data and insights
-
Indepth knowledge of one or more Internet protocols
-
Experience with one or more strongly typed programming languages
-
BS degree in Computer Science related degree or equivalent
-
Understanding/experience in Apache Spark Airflow Databricks AWS and related technologies
-
Fluency in one or more languages like Scala Java Python etc.
-
Understand Continuous Integration (CI) and Delivery (CD) concepts and capabilities to support automation pipelines virtualization and containerization
Desired Skills/Certifications:
-
Data Engineer/SDET
-
Knowledge of Microservices and scaling techniques
-
Experience using web service APIs
-
Ability to create good acceptance and integration test automation scripts and integrate with Continuous Integration (Jenkins/Bamboo) and code coverage tools (Sonar)
-
Certified Associate in Software Testing (CAST)
-
AWS Certified
Java,Scala,Spark,Big Data,Airflow,databricks
Employment Type
Full Time
