Humans in the loop

– 10 min read

Rethinking the hiring process in the AI era with Hilke Schellmann

Alaura Weaver
April 17, 2024

If you’ve participated in a hiring process in recent years — either as a job candidate, as a hiring manager, or as an HR professional, it’s safe to assume you can see where there’s room for improvement. Now that generative AI has entered the scene, is this the opportunity to make the hiring process more efficient and equitable? Or are we running the risk of further spreading systemic biases?

In this installment of Humans of AI, we have a conversation with Hilke Schellmann, an Emmy award-winning journalism professor at NYU and the author of the book The Algorithm: How AI Decides Who Gets Hired, Monitored, Promoted, and Fired and Why We Need to Fight Back Now.

Hilke shares her unexpected journey into tech reporting and discusses the challenges and limitations of AI in the hiring process. She wants HR managers to be more cautious and intentional in their use of AI tools. She also wants vendors to be open about how their algorithms work. And she wants everyone involved in the hiring process, from job candidates to hiring managers to execs, to have informed discussions about what it’ll take to make hiring more efficient and fair.

Episode 8: Rethinking the hiring process in the AI era with Hilke Schellmann

Apr 17· Humans of AI: Presented by WRITER

Summarized by WRITER

• Hilke shares her unexpected journey into tech reporting after a chance encounter with a Lyft driver.
• Hilke believes transparency from AI tool vendors is crucial to allow independent assessment and evaluation of their fairness and effectiveness.
• She urges HR managers to approach AI tools with skepticism, testing and scrutinizing them for biases and potential discriminatory effects.
• A human-centric approach to hiring, considering holistic factors beyond resumes, can create a fair and inclusive process for both job seekers and employers.

The crossroads of social justice and tech reporting

Tech reporting was never on Hilke’s agenda. She’d built her career as a journalist covering social justice issues, always drawn to stories that gave a voice to those who often went unheard. She covered a wide range of topics, from sexual assault in Pakistan to student debt and restaurant grading for prestigious publications like Vice on HBO and The Wall Street Journal.

A chance encounter with a Lyft driver in November 2017 shifted Hilke’s path. The driver shared his experience of being interviewed by a “robot” for a job as a baggage handler at a local airport. What he described was likely a conversational AI system employed to pre-screen candidates before moving them forward to have an interview with a human hiring manager.

Hilke’s curiosity was officially piqued. Her journalistic sense told her there was a story about the use of AI in job interviews. She attended an AI accountability conference happening at NYU shortly after. One woman spoke to big data at work, and the basic algorithms at play that had the potential to cause extreme discrimination.

Job platforms have led to an explosion in applications

The rise of job platforms like Indeed, Monster, and LinkedIn revolutionized the job search process, removing barriers to hiring and making it easier for applicants to apply. Hilke notes that this convenience created a new challenge for HR departments: handling an overwhelming number of applications. Companies like Google and IBM receive millions of applications each year, making it impractical for human resources to manually review every resume.

This created an opportunity for vendors to step in and fill the void with digital tools, which also correlated with the development of AI. Now, AI is used across all stages of the hiring process, most notably at the beginning of the funnel where algorithms conduct automatic rejections based on statistical relevance.

Hilke explains what that statistical relevance might look like in action: “Maybe you give an AI tool the resumes of the 50 accountants that currently are in the job. The tool analyzes which keywords are statistically significant. And statistically, if you have this word on your resume, that implies that you will be successful at this company.”

But AI tools can easily misinterpret statistically significant data as meaningful correlations toward job performance — and that still leads to unintended biases.

Biases in AI screening tools and algorithms

Hilke uses an example of the name “Thomas” to illustrate how algorithmic bias works. Let’s say an AI model trains on examples of resumes of successful employees at a company, and quite a few happened to be named Thomas (one of the most common names for men in the US and England). The AI model may mistakenly interpret the prevalence of the name with the likelihood that the applicant will be successful in a certain job.

Training data inherently reflects the biases of the culture that created it. If marginalized communities are underrepresented in the training data, then the AI system is taught to continue perpetuating these biases. This can create a dangerous cycle where biased inputs lead to biased outputs, as was the case with Amazon’s resume screener a few years ago.

Unmasking the veneer of objectivity

AI systems used in hiring often lack transparency, especially when it comes to how they make decisions and rank candidates. The issue of true objectivity comes up once again when companies use expression recognition and vision technology in video interviews. Hilke questions the assumption that all humans have the same set of emotions, and that facial expressions alone can accurately assess a candidate’s suitability for a job.

Hilke isn’t alone in her concern. The recently passed EU AI Act bans “emotion recognition in the workplace and schools, social scoring, predictive policing (when it is based solely on profiling a person or assessing their characteristics), and AI that manipulates human behavior or exploits people’s vulnerabilities.” This landmark legislation will no doubt serve as a regulatory template for other nations such as the US.

Reimagining the hiring process

According to Hilke, traditional methods of hiring — such as relying solely on resumes and conducting one-way video interviews — may not be the most effective way to assess talent. She suggests reimagining the hiring process by adopting a more holistic approach that considers individuals in a 360-degree manner and considers the teams they’ll be joining.

Hilke’s investigation gives us a call to action to work alongside AI to make the future of recruitment and HR something that works for us rather than the other way around. Rather than succumbing to sensationalism or blindly following trends, we should follow Hilke’s example and stay grounded in the human story. Let’s ask questions, experiment, actively participate, and make decisions that are rooted in the reality of our unique circumstances.