Enter a job title or keyword

Python  PySpark Developer – Data Engineer

CGI


Job Location:

Chennai - India

Monthly Salary: Not provided by the employer
Posted: 17 November 2026 (5 hours ago)
Application Deadline: 14 February 2027
Vacancies: 1 Vacancy

Job Summary

Position Description:

Company Profile:

At CGI were a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72000 professionals located in 40 countries. Founded in 1976 CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources expertise stability and dedicated professionals needed to achieve. At CGI were a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72000 professionals located in 40 countries. Founded in 1976 CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources expertise stability and dedicated professionals needed to achieve results for our clients - and for our members. Come grow with us. Learn more at .

This is a great opportunity to join a winning team. CGI offers a competitive compensation package with opportunities for growth and professional development. Benefits for full-time permanent members start on the first day of employment and include a paid time-off program and profit participation and stock purchase plans. We wish to thank all applicants for their interest and effort in applying for this position however only candidates selected for interviews will be contacted. No unsolicited agency referrals please.
Direct Responsibilities


. Design & develop robust ingestion transformation and enrichment pipelines with Python PySpark and SQL.


. Write and optimize complex SQL queries analytical UDFs and window functions for data aggregation and reporting.


. Collaborate with CEFS data architects data scientists and business analysts to translate functional requirements into technical specifications.


. Unit test integrate test and review code.


. Maintain CI/CD pipelines (Git Jenkins Docker) for automated build test and deployment of jobs.


. Monitor production workloads and troubleshoot performance bottlenecks memory issues and job failures.


. Document data lineage pipeline design and operational run books in Confluence/SharePoint.


. Keep up to date with latest technologies and trends and provide input expertise and recommendations.


Contributing Responsibilities


. Contribute towards innovation (e.g. AI/ML); suggest new technical practices for efficiency improvement.


. Participate in Agile ceremonies (sprint planning daily standups retrospectives) and help groom the backlogs.


. Mentor junior engineers and champion best practices in Python coding Spark optimization and data engineering patterns.


. Evaluate emerging technologies and deliver proof of concepts for CEFS.


Technical & Behavioral Competencies


. Resourceful to quickly understand complexities involved and provide the way forward.


. Good experience in technical analysis of n tier applications with multiple integrations using object oriented APIs & Microservices approaches.


. Strong knowledge about design patterns and development principles.


. Inclination and prior experience of working across SQL Python and ETL.


. Strong Hands on experience Python (NumPy pandas Python Frameworks Restful APIs MS SQL or Oracle.


. PySpark DataFrames Spark SQL Structured Streaming performance tuning (partitioning caching broadcast joins).


. Advanced SQL complex queries stored procedures query optimization.


. Good Knowledge and experience to use Python packages such as Pandas NumPy etc. for cleaning up of Data Data Wrangling Analysis of Data and Visualization of Data.


. Good experience in development and maintenance of code/scripts in both functional and technical specifications of all applications component bug fixing and production support.


. Good knowledge on Linux/Unix environment (basic commands shell scripting etc.) testing phases documentation and new framework.


. Some experience of working with build tools like Maven & DevOps tools like Bitbucket Jenkins.


. Knowledge of Agile Scrum DevOps.


. Development experience in Data Engineering environment.


. Ability & willingness to learn & work on diverse technologies (languages frameworks and tools).


. Self motivated good interpersonal skills and inclination to constantly upgrade new technologies and frameworks.


. Good communication and co ordination skills.


Specific Qualifications:


. Good to have knowledge of front end technologies preferably Flask.


Skills Referential (Required knowledge skills and abilities)


Technical Skills:


o Python


o Pyspark


o SQL


o ETL


Behavioral Skills:


. Ability to synthetize / simplify


. Ability to collaborate / Teamwork


. Attention to detail / rigor


. Ability to deliver / Results driven

Skills:
  • English
  • Docker
  • GIT
  • Jenkins
  • Python
  • SQLite
What you can expect from us:

Together as owners lets turn meaningful insights into action.

Life at CGI is rooted in ownership teamwork respect and belonging. Here youll reach your full potential because

You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction.

Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas embrace new opportunities and benefit from expansive industry and technology expertise.

Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

That same commitment to fairness extends to how we use technology. To support our recruitment team AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

Come join our teamone of the largest IT and business consulting services firms in the world.


Required Experience:

IC


About Company

Company Logo

The COMPANY is one of the few end-to-end consulting firms with the scale, reach, capabilities and commitment to meet clients’ enterprise digital transformation needs. Our 77,500 consultants and professionals work side-by-side with clients in 10 industries across more than 400 location ... View more

View Profile View Profile