Sample of NYC AEDT AI Bias Audit Results

Independent Bias Audit of Employment Decision Tools in compliance with New York City Local Law 144 of 2021

Performed for NewCo LTD (hereafter Newco or “client”), a corporation with offices located at 20 W 34th St., New York, NY 10001

Proceptual LLC performed an independent audit of NewCo’s use of certain automated hiring tools as outlined below. The audit was conducted on data compiled between December 15, 2022, and December 21, 2022; the AI audit was published on December 23, 2022, and is valid until December 23, 2023.

Tools Audited

The following tools were audited on behalf of NewCo; the tools distribution date is also listed

  • Tool X, distribution date November 15, 2022 [Note: “Distribution date” refers to the date the tool was put into use]
  • Tool Y, distribution date October 3, 2021

Proceptual examined the use of the following tools by NewCo and determined that these tools do not qualify as an Automated Employment Decision Tool.

  • Tool Z is used to provide additional information about candidates to a human resources officer. However, the human resources officer’s judgment is the majority and primary determinant of an applicant’s continuation in the hiring process

Status as Independent Auditor

Neither Proceptual LLC nor its equity owners or managers have any financial stake in NewCo, except under the condition that NewCo is or becomes publicly traded, owners or managers may own less than 1% of publicly traded shares in index funds or other instruments. Proceptual LLC has no relationship with NewCo except its status as an independent auditor, including no employment relationship. Neither Proceptual LLC nor its equity owners or managers have any financial stake in any of the automated tools here audited; Proceptual LLC and its equity owners and managers are not and have not been involved in the developing, use, or distribution of any of the tools audited here. Proceptual LLC has no financial relationship with the client except our payment of services rendered for this AI audit.

Audit Process

The following processes were performed for each tool:

  • Selection rate for each category
  • Impact ratio for each category
  • Where applicants are given a numerical score, average score for each category as well as impact ratio

Audit Results

Audit results for [Tool name]. Distribution date: November 15, 2022

This audit was conducted using historical data provided by client to Proceptual LLC.

nyc ai audit hiring law

Native American or Alaska Native Females was found to not be a statistically significant result given the small sample size.

Published Results

As of December 22, 2022, the results of this audit are linked on NewCo’s hiring page at the following URL: newco123.com/careers. The link is marked as follows: “Audit results in compliance with NYC Local Law 144.”

Notice to Candidates and Employees

As of December 22, 2022, the following notification has been added to job postings for roles which make use of the relevant tool as well as generally available on the NewCo careers page at newco123.com/careers

An automated employment decision tool may be used in connection with the assessment of evaluation of candidates for this role. To request alternative accommodations or selection process, email your request to careers@newco1234.com.

The following job qualifications and characteristics will be assessed:

  • [List of qualifications and characteristics assessed]

Information about NewCo’s data retention policy is available upon written request by writing to: <insert address> 

Data Retention Policy

[Provide link to NewCo Data Retention Policy]

Type of Data Collected and Source of Data

This data collection policy can be requested by writing to [Insert NewCo Contact Info]

Disclaimers and Limitations

Proceptual LLC is not a law firm and has not provided legal advice to NewCo.

Proceptual LLC conducted its audit with information supplied by NewCo. We believe we were given access to proper and complete data for performing this audit. Proceptual LLC relied on interviews with NewCo management to identify AEDT tools to be audited.