The Journey to Quality-of-Hire Measurement

You can listen to Eric’s interview on the podcast right here.

Many know it can be difficult to measure the quality of a hiring decision. Just as important is to do so rather quickly, so output from the process can be fed back into the system, improving both the quality and accuracy of subsequent interviews (and their resulting hiring decisions). A major obstacle to measuring quality-of-hire (QoH) is that job candidates are exceptionally complex (we’re human, after all!), and performance reviews typically do not occur for some time (up to a year, in many cases) after hire. Additionally, elevated individual performance is only one (and a rather narrow) potential outcome of a successful hire; what about team/company integration or job fit?

One way to solve this problem is to construct a multi-faceted framework for reflecting on the impact and efficacy of the interview process, and to build that framework in a manner that does not simply provide an assessment of decision quality, but also points to precise points of failure. Here I’ll detail Namely’s internal approach to developing, reporting, and validating our QoH framework.

Pre-Hire

When we set out to measure QoH, Namely had just transitioned to a scorecard-based applicant tracking system, allowing us to collect detailed interviewer ratings of candidates against sets of competencies specific to every role at the company. These scorecards served as key data touch points, in which all candidates were evaluated on multiple competencies by multiple interviewers, providing a rich picture of their interview performance and their demonstration of competencies during their on-site visit.

The QoH Index

In partnership with top-performing managers and executives at the company, we developed a composite QoH index, consisting of four elements: the new hire’s (1) ramp to productivity, (2) job-skill fit, (3) values fit, and (4) “bar-raising” behavior. These components aligned with the hiring goals of the company, and were selected to provide a well-rounded profile of each new hire’s overall early impact.

Data Collection

Due to data availability constraints, the index was designed and launched as a manager-report survey, distributed to managers eight weeks after a new hire’s start date. The survey asked for (1) ratings on each of the four index components, and (2) ratings on the key competencies that the new hire was assessed for in their interview (remember, these are specific to each role!). The survey was fewer than 10 items long, all items were five-point Likert scales, and the whole survey took managers on average 2-3 minutes to complete for each new hire.

Reporting and Continuous Improvement

The four index components were averaged to yield an individual’s QoH score. These individual scores were never used to make decisions about individuals, but were instead reported as the percentage of scores above a “high-quality” threshold (e.g., above 4.0). This “QoH Index” was reported directly to executives and the board of directors on a quarterly basis. The post-hire competency ratings on the survey were tied to the pre-hire ratings of the same competencies from the interviews (because we now had two snapshots of the same person), and through a blend of correlation and regression we were able to identify precise competencies that we were ineffective (or effective) at evaluating as a company, and leverage those learnings when building and improving our interviewer training program.

Validation & Outcomes

Finally, as a result of measuring QoH and feeding these reflections back into the interview and hiring process, Namely saw its overall QoH score increase by 18% over three quarters. Further, the four-item index was found to be both a statistically and practically significant predictor of turnover; employees scoring in the lower half of the QoH scale exhibited a 50% probability of leaving before their one-year mark, while those scoring in the upper half had just a 5% probability of leaving. Interestingly, the most predictive item of both turnover and early job performance was the item on values fit.

This was a brief summary of our journey building a QoH framework. I emphasize the idea of QoH as a framework, not just a metric, because adopting a framework mindset enables you to build and adapt a series of tools or measures (not just one) that empower you to reap all of the benefits of these reflections. Particularly, an understanding of how well we hired, and a hyper-targeted view of where we went wrong (or right).

About the Author

Eric Knudsen
Eric Knudsen is the Manager of People Analytics at Namely, the all-in-one HR software platform for mid-sized companies. Prior to Namely, he contributed to data and analytics work in industries like higher education, aviation, and now technology. His current work focuses on leveraging people data spanning the full employee lifecycle to improve decision-making at Namely. Eric is also a published researcher in industrial-organizational psychology, co-authoring publications in academic outlets like the Journal of Applied Psychology, Encyclopedia of I-O Psychology, and the Handbook of the Psychology of Recruitment, Selection and Employee Retention.

16 Comments on "The Journey to Quality-of-Hire Measurement"

  1. Thiѕ is really intеresting, Υou’rе a vry skilled blogger.
    І’ve joined your rss feed аnd looк forward to seeking m᧐rе of ʏour excellent post.
    Αlso, I’ve shared yоur site іn my social networks!

    http://viagra.bingapproved.club

  2. I visit eacһ day sοme sitees and blogs to read posts, but tһіs blog gives
    quality based writing.

  3. Уoᥙ ɑre sо awesome! I don’t thіnk I’ve trᥙly reаd
    through а single thing lіke tһаt ƅefore.
    Ꮪօ wonderful to discover ѕomeone with original tһoughts οn this subject matter.
    Sеriously.. mmany tһanks for starting this up. This website iis somethiung
    tһat’ѕ neeⅾed οn the internet, someone ѡith ѕome originality!

  4. Having read this I believed it was really informative.
    I appreciate you taking the time and effort to put this informative
    article together. I once again find myself spending way too much time both reading
    and commenting. But so what, it was still worthwhile!

  5. It’s appropriate time to make a few plans for the longer term and
    it’s time to be happy. I have learn this put
    up and if I may just I wish to suggest you some interesting issues or tips.
    Perhaps you can write subsequent articles relating to this article.
    I desire to read even more things approximately it!

  6. I was suggested this blog by my cousin. I am not sure whether this post is written by him as nobody else know such detailed about my trouble.
    You are amazing! Thanks!

  7. What’s Going down i am new to this, I stumbled upon this I’ve found It absolutely helpful and it has helped me out loads.
    I am hoping to contribute & assist other users like its helped me.
    Great job.

  8. For the reason that the admin of this web page is working, no question very rapidly it will be renowned, due
    to its quality contents.

  9. It’s hard to come by well-informed people in this particular subject, but you seem like you know what you’re talking about!
    Thanks

  10. Hi there, this weekend is fastidious for me, because this
    occasion i am reading this impressive informative post here at my house.

  11. Excellent way of describing, and good post to obtain information about my presentation topic, which i am
    going to convey in academy.

  12. Thanks on your marvelous posting! I seriously enjoyed reading it, you’re a
    great author.I will be sure to bookmark your blog and definitely will
    come back later on. I want to encourage continue
    your great job, have a nice morning!

  13. I delight in, cause I discovered just what I used to be looking for.
    You’ve ended my four day lengthy hunt! God Bless you man. Have a great day.
    Bye

  14. Inspiring story there. What happened after? Take care!

  15. Howdy! This is my first comment here so I just wanted to give
    a quick shout out and say I really enjoy reading your blog posts.

    Can you suggest any other blogs/websites/forums that cover
    the same topics? Thanks!

Leave a comment

Your email address will not be published.


*