Data Engineer Hive Hadoop ETL MS SQL PythonJava 1-3 years

Verifi a Visa entity operates a network enabling data sharing among Acquirers Merchants & Issuers for fraud prevention dispute prevention and revenue recovery. Below are the key product solutions which are managed by this technology team 

Intelligence Suite Risk management platform that allows merchant to customize services to protect their business gain greater customer insights and seamlessly keep pace with emerging fraud threats

The Verifi reporting and analytics team is responsible for all facets of architecture software development and production support of data pipelines ETL process reporting and analytics system.

The reporting and analytics team support Visas Business users in Billing Client Services Issuer Processing and Global Contact Center Teams in providing access to data and insights from multiple applications.

As a Data Engineer supporting reporting and analytics group you will be responsible for designing developing and implementing Data integration and Analytics solutions on relational databases (MS SQL Server) using Wherescape Red ETL tool to enable selfservice reporting. Based on deep understanding and knowledge of ETL and data engineering techniques you will develop and maintain data and tools to provide selfservice to Business users. Your ability to work across functions and teams will allow you to drive results and foster the right culture and environment to achieve Engineering Excellence and Innovation.

Essential Functions:

Support Data warehouse Engineering in the architecture development and employment of MS SQL Database on LUW in high SLA environments.

Solid understanding on data model for facts and dimensions. Ability to provide logical and physical design for the given business requirements.

Design scalable data warehouse solution using SQL Server and Hadoop.

Engage in proof of concepts on new SQL Server features and advocate the business benefits to the leadership team.

Provide data warehouse engineering for off the shelf and external merchant facing applications.

Implementation of databases storage structures highavailability solutions replication encryption and disaster recovery solutions.

Follow the industry best practice in writing TSQL code and unit test cases.

Proactive performance analysis troubleshooting and resolution of database issues.

Work very closely with the application team and DBA team to ensure delivery of database services within the SLAs and performance target set.

Integrate the DWH code with the Redgate for the automated deployment.

Support P1/P2 database issues which impacts the customer applications.

Manage support and maintain database technology and infrastructure adhering to the architectural guidelines and policies.

Address vulnerabilities and TSR findings reported by the DBA team.

Ability to work well as a team and as an individual with minimal supervision.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 23 set days a week (determined by leadership/site) with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications :

Basic Qualifications
1 3 years of work experience with a Bachelors Degree or Masters Degree in computer / information science with relevant work experience in IT industry

We need enthusiastic energetic and selflearning candidates with loads of curiosity and flexibility.

Proven handson capability on development of data pipelines / Data engineering.

Basic level Experience in creating data driven business solutions and solving data problems using a wide variety of technologies such as Hadoop Hive Spark MongoDB NoSQL as well as traditional data technologies (RDBMS).

Experience / knowledge developing large scale enterprise class distributed pipelines that require high availability low latency & strong data consistency computing is desirable

Ability to program in one or more scripting languages such as Python and one or more programming languages such as Java or Scala

Design and development skills with Big Data technologies like Hadoop Spark Hive.

Experience with Continuous Integration and Automated Test tools such as Jenkins Artifactory Git desirable

Demonstrated knowledge in POCs and prototypes using Gen AI / ML is an advantage.

Extensive experience in implementing SQL Server 2017 SQL 2019 and MySQL 8.0 features.
Experience in writing complex SQL queries is required.
Hands on experience in Wherescape RED or equivalent ETL tool.
Experience in providing data analysis and data validation is required
Experience in scripting scheduling and version control technologies is required
Good understanding of the high availability and disaster recovery options. Expert in SQL Server native replication.
Experience with tools development automation (CI/CD Auto Deployment with Redgate System Availability etc.).
Extended experience in Agile Release Management practices governance and planning.
Ability to quickly identify and manage/mitigate risks.
Ability to influence Senior Leadership on direction of engineering efficiencies and integration management through data roadmaps short/long term plans etc.
Strong ability to build and sustain working and strategic relationships across technology.
Strong leadership skills with demonstrated ability to lead global crossfunctional teams.
Strong analytical and problemsolving skills.
Ability to maintain composure under pressure and tight deadlines.

Additional Information :

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Remote Work :

No

Employment Type :

Fulltime