Data Engineer Integration Specialist
Data Engineer Integration Specialist
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Data Engineering at the City is a unique opportunity for meaningful exciting work and professional development using stateofthe art technologies and software development best practices. This is a position on a diverse team of engineers analysts and GIS specialists contributing to developing maintaining and optimizing our data pipelines and integration strategies assisting departments and agencies in innovating and enhancing the Citys service to its residents.
The data engineer/integration specialist will develop an intimate understanding of the Citys diverse data and contribute to improving the Citys data engineering infrastructure pipelines models and integrations. The team uses a blend of open source custom developed and offtheshelf tools including Python Bash SQL DBT GIS Docker Terraform Apache Airflow Jenkins Postgres PostGIS AWS GitHub MuleSoft as an iPaaS and SAS API provides like ArcGIS Online and CARTO.
Some prominent services the team is responsible for include DataBridge OITs enterprise data warehouse AIS the Citys custom address information systems which supports public address search and internal geocoding and DatabridgeAirflow a custom workflow generator and orchestrator for departmental integrations () and open data publishing (). Some examples of OITs commitment to serving the public through the effective and innovative integration of City open data include:
We are looking for a candidate who is not only technically skilled but also passionate about leveraging data to improve City operations and community life. This team is fundamental to the innovation of City services that directly affect residents. If you are eager to contribute to a team that values innovation efficiency serviceoriented work and datadriven decisionmaking we encourage you to apply.
Essential Functions
Working with business partners of varying technical ability to understand how their data is produced stored and updated designing enhancements to optimize enterprise integrations and public data accessibility.
Design and develop new and expand and refine existing data pipelines using Apache Airflow custom Pythonbased software and other tools to connect diverse systems of record centralized databases and SaaS environments improving data platform components data governance master data management data standardization enrichment and quality assurance.
Play a key role in enterprise integration and open data initiatives developing and supporting critical systems like the Citys DataBridge DatabridgeAirflow and AIS.
Write clear descriptive technical documentation for systems/applications partner with data stewards of various technical levels and communicate technical details to nontechnical stakeholders.
Competencies Knowledge Skills and Abilities
Competencies:
Clear and concise writing and communication skills.
Creative problemsolving and critical thinking.
Ability to work with data from diverse domains.
Efficient time management and the ability to manage multiple workflows simultaneously.
Ability to seek innovative opportunities and continuous improvement.
Knowledge and Skills:
Proficient in Python
Strong SQL skills and experience with databases (Postgres preferred).
Familiarity with Docker bash and minimal Linux server administration.
Experience with cloud services (AWS preferred).
Understanding of Git/GitHub for version control and CI/CD pipelines.
Experience or ability to learn Airflow DBT Terraform Kubernetes Mulesoft.
Experience working with spatial datasets a plus.
Experience using command line interfaces.
Abilities:
To reason about model and manipulate complex datasets.
To maintain clean and secure data environments.
To work effectively in a hybrid (onpremises and cloud) environment.
To communicate complex technical concepts in understandable terms.
Qualifications :
Bachelors degree in Computer Science Information Systems or a related field. Equivalent work experience may be considered.
Demonstrated experience in data engineering or a similar role with a focus on data management/integration/ETL/ELT.
Proven track record with Python SQL and database management.
Experience with working with modern data engineering tech stack.
Familiarity with development of custom ETL/CI/CD tools and the ability to learn and adapt to new technologies.
Previous work in a public sector or large organization setting is a plus.
Additional Information :
Salary Range: $80000 $91000
Starting salary to be determined based on experience and qualifications.
Important: To apply candidates must provide a cover letter and a resume.
Work Setting: inperson (onsite)
Discover the Perks of Being a City of Philadelphia Employee:
We offer Comprehensive health coverage for employees and their eligible dependents
Our wellness program offers eligibility into the discounted medical plan
Employees receive paid vacation sick leave and holidays
Generous retirement savings options are available
Pay off your student loans faster As a qualifying employer City of Philadelphia employees are eligible to participate in the Public Service Loan Forgiveness program. Join the ranks of hundreds of employees who have already benefited from this program and achieved student loan forgiveness.
Enjoy a Free Commute on SEPTA Starting September 1 2023 eligible City employees will no longer have to worry about paying for SEPTA public transportation. Whether youre a fulltime parttime or provisional employee you can seize the opportunity to sign up for the SEPTA Key Advantage Program and receive free Key cards for free rides on SEPTA buses trains trolleys and regional rails.
Unlock Tuition Discounts and Scholarships The City of Philadelphia has forged partnerships with over a dozen esteemed colleges and universities in the area ensuring that our employees have access to a wide range of tuition discounts and scholarships. Experience savings of 10% to 40% on your educational expenses extending not only to City employees but in some cases spouse and dependents too!
Join the City of Philadelphia team today and seize these incredible benefits designed to enhance your financial wellbeing and personal growth!
*The successful candidate must be a city of Philadelphia resident within six months of hire
Effective May 22 2023 vaccinations are no longer required for new employees that work in nonmedical nonemergency or patient facing positions with the City of Philadelphia. As a result only employees in positions providing services that are patientfacing medical care (ex: Nurses doctors emergency medical personnel) must be fully vaccinated.
The City of Philadelphia is an Equal Opportunity employer and does not permit discrimination based on race ethnicity color sex sexual orientation gender identity religion national origin ancestry age disability marital status source of income familial status genetic information or domestic or sexual violence victim status. If you believe you were discriminated against call the Philadelphia Commission on Human Relations ator send an email to
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
