QA Engineer | Barcelona
Job Summary
TransPerfect helps organizations navigate the global marketplace. Founded in an NYU dorm room in 1992 and still founder-led TransPerfect has grown into the worlds largest translation and language services company with thousands of employees across more than 160 offices worldwide and over $1.3 billion in annual revenue.
The TransPerfect TechOps team builds and supports the technology behind that success from workflow improvements and core GlobalLink platform services to AI-powered language solutions and scalable client-facing applications.
As a QA Engineer you will help ensure the quality reliability security and performance of our web applications APIs and AI-enabled products. You will design and maintain automated tests perform hands-on exploratory and regression testing and work closely with engineering and product teams to identify risks early. You will also use AI-assisted development and testing tools responsibly and contribute to validating AI/LLM features including translation and other generated language outputs.
This position offers:
A significant role in a dynamic QA team part of a technology division within the worlds largest provider of language services and technology solutions
Ownership of test automation and opportunities to influence product quality and release readiness
Collaboration with distributed product development and release teams
Hands-on exposure to AI-enabled products LLM evaluation and modern AI-assisted testing workflows
Opportunities to expand skills in automation frameworks API testing CI/CD and responsible AI quality practices
Your responsibilities will include:
Design implement execute and maintain automated functional integration regression and API tests for web and mobile-enabled applications
Build and improve scalable maintainable test automation frameworks using Playwright Selenium or comparable tools with appropriate code reviews and quality checks
Integrate automated tests into CI/CD pipelines analyze failures reduce flaky tests and provide timely feedback on release quality
Create risk-based test strategies test plans test scenarios and traceable test cases aligned with user stories and acceptance criteria
Perform hands-on exploratory cross-browser system end-to-end database and RESTful API testing as needed
Validate data integrity access control error handling usability and compatibility across supported environments
Identify document prioritize and track defects in Azure DevOps or comparable tools supplying clear steps evidence impact and technical findings
Work with developers product managers QA leads and release managers to assess risks investigate defects and support release-readiness decisions
Test AI-powered features and LLM-based workflows for functional correctness output quality reliability and alignment with requirements
Evaluate AI-generated language and translation outputs using defined criteria such as meaning preservation terminology fluency formatting and locale conventions; collaborate with language specialists when subject-matter review is needed
Design repeatable AI test scenarios and evaluation datasets covering normal edge ambiguous multilingual and adversarial inputs
Identify and document AI-specific failures including hallucinations omissions inconsistent responses bias unsafe outputs and failures to follow instructions or required formats
Account for non-deterministic AI behavior by using appropriate evaluation rubrics comparative baselines sampling and repeat testing rather than relying on exact-text assertions alone
Use approved AI assistants to accelerate test-case design test-data preparation automation scripting coverage analysis debugging and defect reporting; independently verify all AI-generated artifacts
Assess the risks of AI-assisted testing workflows including sensitive-data exposure unsupported assumptions fabricated test evidence and weak assertions; follow company security and data-handling policies
Maintain test assets and technical documentation and proactively recommend improvements to test coverage effectiveness and execution efficiency
Communication:
Communicate test progress quality risks defects and release blockers clearly to QA development and product stakeholders
Collaborate effectively with cross-functional teams across locations and time zones; participate in Agile planning refinement and daily standups
Required skills and experience:
Bachelors degree in Computer Science Engineering a related discipline or equivalent relevant experience
Professional experience in software quality engineering with both manual and automated testing
Hands-on experience developing and maintaining UI or API automation using Playwright Selenium or similar frameworks
Programming proficiency in C# Java or a comparable language used for test automation
Experience with RESTful API testing debugging test-data management and validation of backend behavior
Experience working with CI/CD platforms and defect/test management tools such as Azure DevOps TeamCity or Jira
Ability to analyze requirements develop risk-based coverage and maintain traceability from acceptance criteria to test results
Familiarity with AI-assisted coding or testing tools plus the judgment to review and validate generated code test cases and results
Foundational understanding of LLM capabilities and limitations including hallucinations variable outputs and the need for structured evaluation
Strong analytical troubleshooting documentation and communication skills; ability to work independently and collaboratively
Desired skills and experience:
Experience testing AI/LLM applications machine translation retrieval-augmented generation (RAG) or other generative AI features
Experience creating automated AI evaluations quality rubrics curated datasets or regression benchmarks for model-generated outputs
Knowledge of AI security and safety test scenarios including prompt injection data leakage and inappropriate output handling
Experience development SQL/database validation performance or load testing and service virtualization
Experience with AI coding assistants or agent-based QA workflows including tool integrations and human-in-the-loop validation
Professional working knowledge of an additional language especially for multilingual product testing
Ability to work across time zones and understand complex business workflows
By applying I confirm I have read and accept TransPerfects Privacy Policy: Catalunya Cataluña Spain
Your application has been successfully submitted!
Thank you for your interest - weve already received your application so this new submission cant be accepted. Your previous application is on file.
Required Experience:
IC
About Company
TransPerfect Translations is a translation, E-Discovery and language services company based in New York City. The company serves clients in many fields, such as film, gaming, legal and healthcare fields. As of 2012, TransPerfect is "the largest privately owned language services provid ... View more