Wednesday, November 11, 2026Wed, Nov 11 AboutRSSSubscribe

GMS Agency Desk

The business of agencies and freelancers

Talent & Hiring

Buffer Resources Tests Human And AI Involvement In Hiring Process

Buffer Resources is running an A/B test to determine the best approach to hiring, using human and AI involvement. The test aims to find a balance between efficiency and personal touch in the hiring process.

Original reporting · buffer.com

Original: “We’re running an A/B test on human and AI involvement in hiring”

Read “We’re running an A/B test on human and AI involvement in hiring” at Buffer Resources →
We’re running an A/B test on human and AI involvement in hiring
Image: Buffer Resources

How this was written. GMS Agency Desk wrote this article with a language model from Buffer Resources’s reporting (model: @cf/meta/llama-3.3-70b-instruct-fp8-fast); it describes that reporting rather than adding to it. The original, linked above, is the full story.

Key points from Buffer Resources’s report

  • Buffer Resources is conducting an A/B test to determine the best approach to hiring, using human and AI involvement.
  • The test involves two different roles, with different application processes, to compare the pros and cons of each approach.
  • The company is watching for biases introduced by each approach, the speed of the process, and how candidates and hiring managers feel about each approach.
  • The outcome of the experiment will help Buffer Resources find a balance between efficiency and personal touch in the hiring process.
  • The company plans to share the results of the experiment, including what works and what doesn't.

Buffer Resources, according to Buffer Resources, has been debating the role of AI in its hiring process, seeking to modernize and improve the experience for both candidates and hiring managers. The company wants to maintain a high level of human touch and judgment in hiring, while also leveraging AI to increase efficiency.

The current hiring process at Buffer Resources has become outdated, with long waits for candidates and overworked hiring managers. The company recognizes the need to adapt to the changing job market, where AI-generated applications are becoming more common. This shift has made it challenging for hiring managers to identify thoughtful and personal applications.

To address these challenges, Buffer Resources is conducting an A/B test, with two different approaches to hiring. The first experiment involves an Engineering Manager role, where the application process is lighter and more AI-driven. Candidates are asked to provide a short introduction and join a talent pool, rather than applying for a specific role.

In contrast, the second experiment involves a Security Engineer role, where the application process is more structured and human-led. Candidates are required to answer a series of questions and provide a short video, with a human review of every application. This approach is designed to capture more nuance and allow the human to shine through.

The A/B test is not perfect, as the two roles are in different markets and have different hiring managers. However, running the experiments side by side will provide valuable insights into the pros and cons of each approach. Buffer Resources is watching for biases introduced by each approach, the speed of the process, and how candidates and hiring managers feel about each approach.

The outcome of the experiment will help Buffer Resources find a balance between efficiency and personal touch in the hiring process. If the lighter, AI-assisted approach works well, the company can respond to candidates faster and develop a talent-pool-based approach. If the human-first approach works well, it will indicate that the personal touch is worth protecting, and the company will need to design the application process to allow for this at scale.

Buffer Resources plans to share the results of the experiment, including what works and what doesn't. The company is using AI in its day-to-day work, but emphasizes the importance of thoughtful and personal communication in the hiring process. Candidates are encouraged to use AI tools to assist with their applications, but not to generate entire responses.

Questions and answers

What is the purpose of the A/B test?

The purpose of the A/B test is to determine the best approach to hiring, using human and AI involvement, and to find a balance between efficiency and personal touch in the hiring process.

How will the results of the experiment be used?

The results of the experiment will be used to inform the design of the application process, and to determine whether to use a lighter, AI-assisted approach or a human-first approach.

Can candidates use AI tools to assist with their applications?

Yes, candidates can use AI tools to assist with their applications, such as checking grammar or organizing thoughts, but they should not generate entire responses using AI.

Read the full story at Buffer Resources More from Wednesday, November 11, 2026’s edition