Senior Data Engineer
Senior Data Engineer
Posted on :
16-10-2024
Employer Active
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Job Title: Senior Data Engineer
Location: Chicago IL (Hybrid 2 days from office)
Duration: 6 Months
Implementation Partner: Blue.cloud
End Client: To be disclosed
Location: Chicago IL (Hybrid 2 days from office)
Duration: 6 Months
Implementation Partner: Blue.cloud
End Client: To be disclosed
What this job involves:
We are looking for a Staff Data Engineer who is selfstarter to work in a diverse and fastpaced environment that can join our Enterprise Data team. This is an individual contributor role that is responsible for designing and developing of data solutions that are strategic for the business and built on the latest technologies and patterns. This a global role that requires partnering with the broader team at the country regional and global level by utilizing indepth knowledge of data infrastructure technologies and data engineering experience.
As a Senior Data Engineer you will:
- Design Architect and Develop solutions leveraging cloud big data technology to ingest process and analyze large disparate data sets to exceed business requirements
- Develop systems that ingest cleanse and normalize diverse datasets develop data pipelines from various internal and external sources and build structure for previously unstructured data
- Interact with internal colleagues and external professionals to determine requirements anticipate future needs and identify areas of opportunity to drive data development
- Develop good understanding of how data will flow & stored through an organization across multiple applications such as CRM Broker & Sales tools Finance HR etc
- Unify enrich and analyze variety of data to derive insights and opportunities
- Design & develop data management and data persistence solutions for application use cases leveraging relational nonrelational databases and enhancing our data processing capabilities
- Develop POCs to influence platform architects product managers and software engineers to validate solution proposals and migrate
- Develop data lake solution to store structured and unstructured data from internal and external sources and provide technical guidance to help migrate colleagues to modern technology platform
- Contribute and adhere to CI/CD processes development best practices and strengthen the discipline in Data Engineering Org
- Mentor other members in the team and organization and contribute to organizations growth.
What we are looking for:
- 6 years work experience and bachelor s degree in Information Science Computer Science Mathematics Statistics or a quantitative discipline in science business or social science.
- Handson engineer who is curious about technology should be able to quickly adopt to change and one who understands the technologies supporting areas such as Cloud Computing (AWS Azure(preferred) etc.) Micro Services Streaming Technologies Network Security etc.
- 3 or more years of active development experience as a data developer using Pythonspark Spark Streaming Azure SQL Server Cosmos DB/Mongo DB Azure Event Hubs Azure Data Lake Storage Azure Search etc.
- Design & develop data management and data persistence solutions for application use cases leveraging relational nonrelational databases and enhancing our data processing capabilities
- Build test and enhance data curation pipelines integration data from wide variety of sources like DBMS File systems APIs and streaming systems for various KPIs and metrics development with high data quality and integrity
- Maintain the health and monitoring of assigned data engineering capabilities that span analytic functions by triaging maintenance issues; ensure high availability of the platform; monitor workload demands; work with Infrastructure Engineering teams to maintain the data platform; serve as an SME of one or more application
- Team player Reliable selfmotivated and selfdisciplined individual capable of executing on multiple projects simultaneously within a fastpaced environment working with cross functional teams
- 3 years of experience working with source code control systems and Continuous Integration/Continuous Deployment tools
- Independent and able to manage prioritize & lead workload
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
