Big Data Developer
Big Data Developer
Posted on :
28-09-2024
Employer Active
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Big Data Developer (2)
Python PySpark Hadoop Big Data Java
- 8 years of experience in Python PySpark Hadoop Big Data
- Build PySpark based applications for both batch and streaming requirements which will require indepth knowledge on majority of Hadoop and NoSQL databases as well. Optimize performance of the built Spark applications in Hadoop using configurations around Spark Context SparkSQL Data Frame and Pair RDDs. Should be skilled to use APIs in order to process huge datasets. They can run Spark/pyspark on open source frameworks such as Hadoop in the cloud with complicated data.
- Develop test and maintain highquality software using Python programming language. Participate in the entire software development lifecycle building testing and delivering highquality solutions. Collaborate with crossfunctional teams to identify and solve complex problems.
- Strong Backend development Experience in Python
- Good Understanding of python libraries like Pandas Polars NumPy Matplotlib Plotly Seaborn Altair.
- Conceptually Strong in Python and Analytics
- Design and implement web applications using Python framework like Streamlit.
- Design visualizations custom widgets and components translate complex data processing and analysis tasks into intuitive userfriendly web interfaces.
- Collaborate with backend developers to integrate APIs and databases with Streamlit applications.
- Working with large data sets and incomplete information as required.
- Working with users business stakeholders product owners /technology teams to deeply understand customer needs develop solutions independently.
- Experience of working in a financial organization or awareness of financial concepts especially related to Trading hub.
- Rewrite and decom legacy controls: consider a python framework for converting RBS Java for scenarios outside Trading Hub and BABS to transition all remaining legacy RBS scenarios to new Surveillance capabilities.
Employment Type
Full Time
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
