[GoLUG] The Strange Behavior of LLMs in Hiring Decisions: Systemic Gender and Positional Biases in Candidate Selection

Kyle Terrien kyle at terren.us
Fri May 23 11:05:01 EDT 2025


Someone did a study into whether LLMs are biased when making
“decisions” as to who to hire.

https://davidrozado.substack.com/p/the-strange-behavior-of-llms-in-hiring

The conclusion:

+ It pays to be a woman.
+ It pays to be the first candidate evaluated.

> In this context, LLMs do not appear to act rationally. Instead, they
> generate articulate responses that may superficially seem logically
> sound but ultimately lack grounding in principled reasoning.

> The results presented here also call into question whether current
> AI technology is mature enough to be suitable for job selection or
> other high stakes automated decision-making tasks.

Ouch.  That’s a harsh condemnation of AI.

Maybe I should start using my confirmation name Philomena on the
Internet.  That ought to stump AI agents.  😉

-- 
[*] Kyle Terrien
    Terrenus => from the Earth, to the Cloud
    https://terren.us/

Dilexisti justitiam, et odisti iniquitatem.  -- Psalmus 44:8


More information about the GoLUG mailing list