Independent Audit of Employment Decision Tools in Compliance with New York City Local Law 144 of 2021

Performed for Multiverse US, Inc (hereafter Multiverse), a corporation.

Proceptual, Inc. (hereafter Proceptual) performed an independent audit of Multiverse’s use of certain automated hiring tools as outlined below. The audit was conducted on data compiled between June 2023, and June 2024; the audit was published on July 5, 2024, and is valid until July 5, 2025.

Multiverse had previously completed an audit of the same tool that was valid between July 5, 2023 and July 5, 2024.

Tools Audited

The following tools were audited on behalf of Multiverse; the tools distribution date is also listed.

Multiverse SJT, which has been in use since October, 2022

Multiverse did not ask Proceptual to evaluate any other tool. Proceptual was not asked to and did not determine whether or not the audited tool falls under the definition of “AEDT” for the purposes of Local Law 144.

Status as Independent Auditor

Neither Proceptual nor its equity owners or managers have any financial stake in Multiverse, except under the condition that if Multiverse becomes publicly traded, owners or managers may own less than 1% of publicly traded shares in index funds or other instruments. Proceptual has no relationship with Multiverse except its status as an independent auditor, including no employment relationship.

Neither Proceptual nor its equity owners or managers have any financial stake in any of the automated tools here audited; Proceptual and its equity owners and managers are not and have not been involved in the developing, use, or distribution of any of the tools audited here. Proceptual has no financial relationship with the client except our payment of services rendered for this AI audit.

Audit Process

The following processes were performed for each tool:

Selection Rate for each category, with Selection Rate defined as the rate at which individuals in a given category exceeded the pass rate

Impact Ratio for each category

Audit results for Multiverse SJT. Distribution date October 22, 2022

This audit was conducted using historical data provided by client to Proceptual.

Sex Analysis

	Count	# Above Pass	Selection Rate	Impact Ratio
Male	2459	1830	0.74	0.96
Female	1688	1315	0.78	1.00

166 candidates were not counted in the Sex Category analysis because either the data was not collected, or the applicant responded “other.”

Racial Analysis
	Count	# Above Pass	Selection Rate	Impact Ratio
White	814	666	0.82	1.00
Hispanic	573	440	0.77	0.94
Asian	402	307	0.76	0.93
Black	1652	1216	0.74	0.90
American Indian or Alaska Native	28	20	0.71	0.87
Hawaiian Native or Pacific Islander	22	19	0.86	1.06
Two or More races	466	345	0.74	0.90

Hawaiian Native or Pacific Islander was the highest scoring group in the sample. However, because that group was under 2% of the total sample, the next highest scoring group was used for group comparison.

356 candidates were not counted in the Racial Category analysis because either the data was not collected, or the applicant responded “other.”

Intersectional analysis

	Count	# Above Pass	Selection Rate	Impact Ratio
White male	533	436	0.82	1.00
white female	259	209	0.81	0.99
Hispanic male	354	272	0.77	0.94
Hispanic female	202	155	0.77	0.94
Asian male	261	191	0.73	0.89
Asian female	136	111	0.82	1.00
Black male	866	607	0.70	0.86
Black female	749	580	0.77	0.95
Native American or Alaska Native male	12	9	0.75	0.92
Native American or Alaska Native female	15	11	0.73	0.90
Native Hawaiian or Pacific Islander male	12	10	0.83	1.02
Native Hawaiian or Pacific Islander female	10	10	1.00	1.22
Two or more races male	263	190	0.72	0.88
Two or more races female	184	140	0.76	0.93

Native Hawaiian or Pacific Islander female was the highest scoring group in the sample. However, because that group was under 2% of the total sample, the next highest scoring group was used for group comparison.

457 candidates were not counted in the Racial Category analysis because either the data was not collected, or the applicant responded “other.”

Throughout the sample, we found no evidence of statistically significant bias.

Data Retention Policy

Multiverse’s privacy policy can be found here. https://www.multiverse.io/en-GB/our-policies/privacy-policy. Data from the audited tool may be retained indefinitely. Data for the tool is collected from a candidate-taken test. The data collected is supplied as test responses by the candidate. This data collection policy can be requested by writing to Welcome@multiverse.io.

Disclaimers and Limitations

Proceptual is not a law firm and has not provided legal advice to Multiverse.

Proceptual conducted its audit with information supplied by Multiverse. We believe we were given access to proper and complete data for performing this audit.