Tier 1 Management Consultancy

Problem: The consultancy developed a solution to  help with planning of talent management requirements for organizations by defining future needs and understanding how they can be fulfilled either with internal resources or new hires. As an HR tool, the consultancy and its customers worried about bias. 

‍

Armilla AI’s Solution:

• Evaluated a sample configuration with 42 jobs and 438 employees
• Created an independent inference method using the candidate’s first name and surname combined with US Census data  to append gender and ethnicity to the dataset
• Performed a bias audit, comparing favorable outcomes across demographics in line with methodology in New York Local Law 144

‍

Outcome: Armilla AI’s assessment concluded there is no indication that the model introduces bias that could lead to unfair outcomes. This allowed the consultancy to comply with NYC Local Law 144 and offer a performance guarantee to build trust with customers.

‍

“Armilla’s ability to provide warranty coverage on AI/LLM-powered products it tests and evaluates makes it an invaluable partner in our consulting projects, helping build even greater confidence in the quality and trustworthiness of AI products we build for customers.”

• Chief AI Ethics Officer