Role: Senior AWS Data Engineer
Location: Mountain View CA Hybrid Role
Job Type: Contract
Must Have Skills: AWS Cloud Python PySpark SQL Queries BigData
Job Description:
- Create and maintain optimal data pipeline using Python Spark
- Build the infrastructure required for optimal extraction transformation and loading of data from a wide variety of data sources using Python (PETL CXORACLE Sybase DB2 JASON NUMPY PANDAS. PYSPARK)
- Able to storemigrate data files securely between OnOff Premises in AWSS3
- Able to manipulate file or data in cloud using AWS Lambda Function Glue ETL Step function
- Work with data and analytics experts to strive for greater functionality in our data systems
- Advanced SQL skills and ability to write and analyze medium to complex SQLs
- Experience in building processes supporting data transformation data structures metadata dependency and workload management
- Strong analytic skills related to working with unstructured datasets
- Have experience in DevOps processes using Git and Jenkins
- Good exposure to Agile and tools like Jira Confluence