Applicant Screening Vendor

Problem: The vendor screening tool helps employers readily identify relevant skills in a candidate’s resume or cover letter. As an HR tool, the vendor and its customers worried about bias and compliance with NY Local Law 144. They were also looking for a way to differentiate their product in a crowded market.

‍

Armilla AI’s Solution:

• Evaluated robustness by perturbing the data to compare the extracted skills to the baseline for each resume using the intersection over union of the sets of skills. Tested similarity with the Kendall’s Tau coefficient between the original and the new list of skills for each candidate
• Performed a bias audit, comparing favorable outcomes across demographics in line with methodology in New York Local Law 144

‍

Outcome: Armilla's certification and warranty significantly enhanced the value of the vendor’s AI models, building trust and differentiation. The alignment with ethical and responsible AI principles also contributed to the acquisition of the vendor in 2024, recognizing Armilla’s assessment as a testament to the vendor’s commitment to responsible AI.

‍

“Armilla's third-party certification and warranty played a key role in highlighting the performance and fairness of our AI models, which made our business even more attractive to customers, and aligned with Cornerstone’s shared commitment to ethical and responsible AI.”

• CTO

‍

In 2024, Cornerstone OnDemand acquired [the vendor], noting Armilla’s Assessment of Skyhive’s technology as a key indicator of their commitment to responsible AI.

‍