drjobs Data Engineer

Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

India

Monthly Salary drjobs

INR INR 5500000 - 6000000

Vacancy

1 Vacancy

Job Description

Candidates MUST be authorized to work without sponsorship

*Candidate must be able to work EST hours from day 1* Remote

We are seeking a highly skilled Senior Data/Software Engineer with expertise in CI/CD pipelines automation and fullstack development to drive a highpriority project. This role involves building and testing code through CI/CD pipelines in AWS managing test case definition and storing data in a Datalake. The role is critical in meeting tight deadlines with a focus on delivering product readiness by midOctober and full results by the end of October.

Top Requirements: JAMA BAZEL Step Functions Python and AWS

Key Responsibilities:
CI/CD Development: Build and manage CI/CD pipelines using Jenkins and Bazel for continuous integration and testing.
Test Case Management: Define test cases with strict adherence to requirements and ensure documentation is stored in Jama.
Scripting & Automation: Perform heavy scripting and automation tasks to streamline processes.
Datalake Management: Store and manage CI test results in a Datalake accessible through APIs.
AWS Infrastructure: Utilize AWS services including EC2 and Terraform to build maintain and automate the infrastructure.
API Integration: Drive extensive API integration work for seamless data access and functionality.
Simulation Testing: Conduct sensor simulation tests and provide detailed reports on status and results.
Leadership & Oversight: Assign and manage contractors to ensure smooth project execution track progress and address any technical questions or concerns.

Skills & Experience Required:
Strong background in CI/CD pipeline development using Jenkins and Basil.
Experience with AWS services (EC2 Datalake Terraform).
Proficient in scripting and automation with handson experience in API integration
Ability to manage test case creation and reporting in Jama.
Experience with fullstack development with a focus on automation.
Strong problemsolving and project management skills to meet tight deadlines.
Excellent communication and leadership skills with the ability to manage and mentor contractors.

Preferred Qualifications:
Prior experience in sensor simulation testing and familiarity with testing frameworks
Experience with Bazel for build and testing frameworks.
Strong organizational skills to ensure all timelines are met.
System Description!!!
Product Readiness Report Overview:
  1. Objective:
  • Build and test code through CI/CD pipelines.
  • Store results in the datalake accessible via API.
  • Define and execute test cases with strict adherence to requirements recorded in Jama.
  1. Technologies & Tools:
  • CI/CD: Jenkins pipelines in AWS.
  • Build & Testing Frameworks: Bazel.
  • Infrastructure: Terraform EC2.
  • Data Storage: Datalake with API integration.
  • Scripting & Automation: Heavy emphasis on scripting and automation.
  • FullStack Skills: Required though frontend specifics are uncertain.
  1. Responsibilities:
  • Create and store CI test results in the datalake.
  • Drill down into test results to assess basic status and specifics around sensor test simulations.
  • Manage tight deadlines:
  • MidOctober for initial results.
  • End of October for final results.
  1. Team Structure:
  • Senior engineer assigned to manage contractors.
  • Drive production track progress and address questions.
  1. Project Duration:
  • 3 months.
  1. Start Date:
  • Immediate start required to meet deadlines.

full-stack development,communication,ci,ec2,bazel,test case management,api integration,problem-solving,datalake management,automation,jenkins,project management,data,terraform,leadership,aws services,scripting,ci/cd pipeline development,integration

Employment Type

Full Time

Company Industry

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.