Senior Consultant, Data Engineer

We are hiring for a fast-growing digital agency of 120+ people specializing in fintech. Our fully remote team is driven by innovation and experimentation. Over the past decade, we've shipped over 150 products for clients that include Visa, the United Nations, Wells Fargo, Ernst & Young, and TOMS Shoes. Our founders built a previous agency (Monsoon) that was acquired by Capital One in 2015.

As a Data Engineer Sr. Consultant Level you will lead, design, develop, test, enhance and build our services with technology teams for Customers in an agile development environment. You will work with colleagues who help, support and challenge you daily. Unit testing, code reviewing, and regular check-ins for continuous integration are just part of your DNA. You will be a key player in lifting the Engineering Excellence of your and surrounding teams. You drive multiple scrum teams to drive them and execute the business requirements. If this sounds exciting, we would love to chat and tell you more about our work culture and environment.

This position reports to the Director of Business Solutions Data product development and is based in Austin, Texas.

You will drive technical solutions that directly impact the payment industry. The solutions you design will be large-scale, always available, secure, fast, accessible, and globally ready, with an impact measured in future years.

Your solutions will be used by millions of people worldwide every minute of the day. You will have the opportunity to bring your creative curiosity and technology experience to work daily and help build platforms and solutions consumed across Business Data Solutions platforms to create seamless, fast, reliable, and user-friendly experiences.

You will interact with organizational stakeholders such as senior executives, senior leads, senior managers, senior product managers, and external partners. In addition, you will have the opportunity to build technical solutions and influence release roadmaps.

You will be an integral part of the Business Data Solutions Team and have the opportunity to build the data solutions that deliver on the organizational vision for consistency, quality, developer productivity, security, reusability, and availability across a global infrastructure.

The successful candidate to fill this role will strongly influence new payment flows design, including Commercial payments, B2B payments, and Small Business and Government Payments.

Technical environment: Bigdata open source technologies and relational databases across platforms e.g., Big Data, Spark, Scala, Java, Hadoop, HBASE, DB2, MySQL, Kafka, Streaming, Oozie, Sqoop, Unix Scripting, Rocks DB, Data API, MapReduce, Airflow. The job involves data architecture, design, development, optimization, setting expectations, and SLAs, focusing on reliability, availability, and performance to enable Global clients.

We are looking for a self-motivated individual with Data engineering skills and expertise in Big Data systems integration and technologies. The candidate will be extensively involved in hands-on activities, including POCs, design, development, and documentation, focusing on monetizing data and helping enable our Commercial clients globally. Success in this role will require technical depth and a customer-focused demeanor with a self-motivating personality and a strong work ethic. Superior communication skills, verbal, written, listening, and presentation, are a must.

This position reports to the Director of Business Solutions Data product development and is based in Austin, Texas.

Essential Functions:

• Perform Business Requirements analysis and translate requirements into technical requirements.

• Architect, Design, and Develop data-driven ETL applications and services

• Provide technical expertise in leading and driving projects from inception to closure

• Work independently and effectively with cross-functional teams on a case-by-case basis.

• Work with the Product team, other data engineers, and DevOps to deliver features on time.

• Develop ETL data pipelines using open-source big data technologies.

• Serve as a technical mentor for the development team. Be a change agent with a hands-on ability to build POC products and set the best practices.

• Perform code reviews and help the team to produce quality code.

• Work in a geographically distributed team setup.

• Propose new solutions to meet the fast-changing payments industry landscape.

• Identify opportunities for further enhancements and refinements to standards and processes.

• Fine-tune the existing application with new ideas and optimization opportunities to reduce latency and meet client SLAs.

• Build a data strategy to enable both short-term and long-term needs for an extensible, trustworthy, and modern data architecture capable of evolving with changing needs.

• Scoping/Effort Estimates: contribute to solution scoping and effort sizing with a cross-functional team.

• Research: stay informed on technology trends and product roadmaps to make informed solution architecture recommendations.

• Lead/Work with the multiple scrum teams with data engineers to provide the solutions and implement them by driving the delivery teams.

Qualifications

• 10+ years of relevant work experience with a Bachelor's Degree or at least 8+ years of relevant work experience with a Master's Degree or a Ph.D.

• Bachelor's degree in a technical field such as computer science, computer engineering, or related field required. Advanced degree preferred

• Minimum of 10+ years of software development experience (with a concentration in data-centric initiatives), with demonstrated expertise in leveraging development best practice methodologies.

• Minimum of 8+ years of experience building large-scale applications using open-source technologies. Design and coding skills with Big Data technologies like Hadoop, Spark, Scala, Java, Hive, HBase, Oozie, Data APIs, streaming, and Map Reduce.

• Relevant experience with software design, Data engineering, architecture, and ETL data pipeline development life cycle.

• Hands-on expertise with Spark/Scala or Spark/Java or Spark/Python.

• Experience with highly distributed, scalable, concurrent, and low latency systems.

• Deep knowledge of Unix/Linux, Shell Scripting, and writing SQL queries.

• Deep knowledge of all Data Warehouse related components (Sourcing, ETL, Data Modeling, Infrastructure, Reporting, Data Visualization) and multiple tools to support those components.

• Strong foundation in computer science, with strong competencies in data structures, algorithms, and software design optimized for building highly distributed and parallelized systems.

• Experience with Agile methodologies. Work experience in improving the client experience.

• Excellent analytical and problem-solving skills with robust automation and customer mindset

• Ability to handle multiple competing priorities in a fast-paced environment

• Must have strong interpersonal and communication skills (written and verbal). Should be comfortable facilitating multi-team activities.

• A payment processing background is a big plus.