Testlio, a company that offers crowdsourced software testing, has announced a new end-to-end testing solution designed specifically for testing AI solutions.
Leveraging Testlio’s community of over 80,000 testers, this new solution provides human-in-the-loop validation for each stage of AI development.
“Trust, quality, and reliability of AI-powered applications rely on both technology and people,” said Summer Weisberg, COO and Interim CEO at Testlio. “Our managed service platform, combined with the scale and expertise of the Testlio Community, brings human intelligence and automation together so organizations can accelerate AI innovation without sacrificing quality or safety.”
The AI testing solution allows customers to validate AI model behavior in real-world conditions spanning different 100+ languages, 600k+ devices, and 150+ countries; detect and mitigate hallucinations, bias, or other harmful automation; simulate red team scenarios to find prompt injection, jailbreak, and compliance vulnerabilities; and identify drift, regression, and degradation.
According to initial use of the new solution, 82% of AI issues contained hallucinations or misinformation, 79% of bugs were classified as medium or high severity, and the top risk was AI systems confidently mixing facts with incorrect information.
“When AI gets it wrong, it can mislead users, show bias, or create unsafe outputs that harm your brand. Testlio’s crowdsourced AI testing adds the scale, expertise, and real-world diversity your internal teams need to uncover hidden issues before release,” the company explained.
Testlio’s AI testing solution is available now.
