Using Competency Models to Assess Employment Candidates and Employees
HR管理2.77W
Validation of Selection Criteria
When determining the validity of competencies for use in either candidate selection or employee assessment, there are two distinct kinds of validity that should be considered. These are:
Content Validity
Empirical Validity
Content Validity
Content validity refers to the knowledge, skills, and abilities needed for successful job performance by virtue of the work itself. A good question to ask when establishing whether a given competency is content-valid is, "What is the degree of impact this competency has on job performance? How critical is it?" Another factor to consider is, "How often is this competency used in performing the work"?
When establishing selection criteria, from a legal defensibility standpoint, it is best to focus on "skills and abilities" rather than "knowledge." The reason is, courts will question whether or not the employer provides (or could have provided) short-term training to develop the necessary knowledge. As an employer, this argument can be tough to defend.
In order to be considered valid, job-content based criteria must be "verifiable." There needs to be some statistical evidence showing the evaluation criteria being used is "essential" or "critical" to successful job performance. In order for criteria to be considered "verifiable," the employer needs to show there has been an independent validation of the data by multiple raters (usually 3 or more) who are job knowledgeable.
Job knowledgeable persons, sometimes referred to as an "expert panel," are persons who have actually performed the work, but can also include others who supervise the work and are intimately familiar with the requirements of the job.
Process for Establishing "Content Validity"
The recommended process for establishing content validity is as follows:
Create an expert panel, 3 or more persons who are "job knowledgeable"
Choose persons who have actually performed the work as well as
those who have supervised it
Panel should always include two or more current (or past) job incumbents
Review job description to determine key challenges, responsibilities, and expected results.
Use group process to define a "preliminary list" of competencies felt to be critical to job performance. (HR Technologies, Inc. provides a "competency lexicon" and software to facilitate this process.)
Have each panel member independently (without discussion) assign a weighting to the listed competencies using a 5-point weighting scale, thereby reflecting the "relative" importance of each competency to successful job performance.
Use group process to fine-tune these weightings and arrive at a final, consensus weighting for each competency.
Finalize the competency list, with the group agreeing to eliminate lower-weighted criteria and arriving at a final competency set (i.e., the "assessment model").
Focus the group primarily on selecting competencies that are "skills and abilities," eliminating those that are knowledge-based (especially those competencies easily addressed through short-term training).
Use the group to establish "behavioral anchors" (i.e., definitions or examples of performance levels) for each competency contained in the selection model, thus providing an objective, uniform scale for assessing employees and determining their competency "level."
Empirical Validity
Empirical validity requires that evaluation criteria be "statistically verifiable". This means the employer must demonstrate there is a high degree of mathematical correlation between a given competency and successful job performance.
If, using performance evaluation data, you can demonstrate that a high percentage of top performers possess a certain competency and can further demonstrate this competency is relevant to their high performance level, you can make a pretty strong case that the competency in question is "empirically valid".
In the case of sales positions, for example, if you can show there is a high degree of correlation between sales volume and certain competencies, those competencies are considered to be empirically valid. They are statistically relevant to sales performance. In such cases, you need to be able to show that those who posses these competencies consistently achieve high sales volume (i.e., they consistently beat sales quota). On the other hand, those who lack these same competencies consistently deliver lower sales volume (i.e., they are consistently below quota).
Put simply, to test for the validity of the competency selection model:
Employees who fit the model consistently beat sales quotas
Those who don’t fit the model consistently fall short of quota
Competencies that have been empirically validated are highly defensible from a legal standpoint and can easily be demonstrated to be valid criteria for either candidate selection or employee assessment.
Where possible, therefore, empirically validated competencies need to be identified and added to those that are job-content based to arrive at a final competency model.
Employee Assessment & De-selection Process
When using the competency model for de-selection purposes, it is important employee evaluation be a "multi-rater" process. Preferably there should be 3 or more raters, each having first-hand knowledge of the employees to be rated. This should obviously include the employee’s immediate supervisor and other management personnel familiar with the quality of the employee’s work.
Additionally, where available, the last two performance evaluations for each employee should be provided to the members of the evaluation team, as well as any other performance-related documentation contained in the employee’s human resources file. Also, when using empirically validated competencies, you should have the last two years of measurable performance data available for use in the assessment process. For example, if a sales employee, empirical data might include:
Sales volumes for last 2 years
Sales volume increases for last 2 years (dollars and percentages)
Established sale quotas (if any)
Performance against quota (i.e., percent of quota achieved) for last 2 years
The following process is then recommended for use by the evaluation team in the actual evaluation of employees:
Evaluation team reaches consensus on a uniform employee evaluation scale (usually 1 to 4) based on employee competency level.
4 = Superior level of competency (has few, if any, peers)
3 = Above average level of competency (competency is higher
than most)
2 = Average (acceptable) level of competency
1 = Below average (unacceptable) level of competency
Where they exist, pre-established "behavioral anchors" (i.e., pre-determined performance levels for each competency, along with their respective definitions) should be used in the place of the above general, numerical rating scale.
Team members independently (without discussion) evaluate each employee against the competency model and record their ratings
Independent rating scores are then averaged for each competency, and the employee then receives a final score by multiplying the average evaluator rating for each competency times its pre-assigned weighting.
A "cut-off score" is then established so that it yields the number of employees needed to reach the program’s objective.
The cut-off score is applied and employees whose scores are below the cut-off are identified and placed on a "target list."
Adverse Impact Analysis
Once employees are identified for de-selection purposes, an analysis needs to be performed to determine whether there has been adverse impact on any particular "protected class" employee grouping (i.e., race, creed, color, age, sex, national origin, or disability). Where the percentage of a certain protected class of persons selected for employment separation is disproportionate to that of non-protected classes, the selection process is said to have had an "adverse impact" on that protected class grouping.
In such cases, it is important to identify and closely examine the specific competencies that consistently caused the low rating of the affected class members. Once identified, it is important to verify that these competencies have been appropriately validated, and are therefore legally defensible in the event of lawsuit. Where such competencies have been empirically validated, there should be no problem, and the company can feel free to move ahead with little or no risk.
Although not as readily defensible in a court of law, content-validated competencies need to be more closely examined to be sure they have been properly validated from the legal perspective.
In final analysis, however, where evaluation criteria have been properly validated (either empirically or on the basis of job content), there should be little or no risk of an adverse impact lawsuit being successful. In all cases, such validation should hold up well in court.
Due to the high volume of adverse impact-based lawsuits and the ever-changing legal landscape as molded by continuous court decisions, it is strongly recommended that the entire validation process and results be thoroughly reviewed and blessed by your corporate attorneys or outside legal counsel before proceeding with employee notifications.
Differential Treatment
The rule of thumb, when assessing employees (or employment candidates), is "make sure that you consistently treat all employees the same". Application of certain criteria or reasoning to one employee (or groups of employees) and not to others (i.e., "differential treatment"), is an open invitation to time-consuming, expensive litigation. Where "adverse impact" can give rise to "group" class action lawsuits, "differential treatment" can give rise to lawsuits by "individual" employees who believe they have been "singled out".
The key to avoiding this type of lawsuit is consistent treatment of all employees. If you apply certain criteria, standards, or logic to one employee, make sure you apply the same criteria to all other employees. For example, in de-selection, should you elect to exempt an employee from a large sales loss on the basis "she had no control", make sure to exempt other employees with large sales losses if the same basis and logic should apply.
The best advice is, treat all employees uniformly and consistently and the threat of potential lawsuits on the basis of "differential treatment" goes away entirely.
When determining the validity of competencies for use in either candidate selection or employee assessment, there are two distinct kinds of validity that should be considered. These are:
Content Validity
Empirical Validity
Content Validity
Content validity refers to the knowledge, skills, and abilities needed for successful job performance by virtue of the work itself. A good question to ask when establishing whether a given competency is content-valid is, "What is the degree of impact this competency has on job performance? How critical is it?" Another factor to consider is, "How often is this competency used in performing the work"?
When establishing selection criteria, from a legal defensibility standpoint, it is best to focus on "skills and abilities" rather than "knowledge." The reason is, courts will question whether or not the employer provides (or could have provided) short-term training to develop the necessary knowledge. As an employer, this argument can be tough to defend.
In order to be considered valid, job-content based criteria must be "verifiable." There needs to be some statistical evidence showing the evaluation criteria being used is "essential" or "critical" to successful job performance. In order for criteria to be considered "verifiable," the employer needs to show there has been an independent validation of the data by multiple raters (usually 3 or more) who are job knowledgeable.
Job knowledgeable persons, sometimes referred to as an "expert panel," are persons who have actually performed the work, but can also include others who supervise the work and are intimately familiar with the requirements of the job.
Process for Establishing "Content Validity"
The recommended process for establishing content validity is as follows:
Create an expert panel, 3 or more persons who are "job knowledgeable"
Choose persons who have actually performed the work as well as
those who have supervised it
Panel should always include two or more current (or past) job incumbents
Review job description to determine key challenges, responsibilities, and expected results.
Use group process to define a "preliminary list" of competencies felt to be critical to job performance. (HR Technologies, Inc. provides a "competency lexicon" and software to facilitate this process.)
Have each panel member independently (without discussion) assign a weighting to the listed competencies using a 5-point weighting scale, thereby reflecting the "relative" importance of each competency to successful job performance.
Use group process to fine-tune these weightings and arrive at a final, consensus weighting for each competency.
Finalize the competency list, with the group agreeing to eliminate lower-weighted criteria and arriving at a final competency set (i.e., the "assessment model").
Focus the group primarily on selecting competencies that are "skills and abilities," eliminating those that are knowledge-based (especially those competencies easily addressed through short-term training).
Use the group to establish "behavioral anchors" (i.e., definitions or examples of performance levels) for each competency contained in the selection model, thus providing an objective, uniform scale for assessing employees and determining their competency "level."
Empirical Validity
Empirical validity requires that evaluation criteria be "statistically verifiable". This means the employer must demonstrate there is a high degree of mathematical correlation between a given competency and successful job performance.
If, using performance evaluation data, you can demonstrate that a high percentage of top performers possess a certain competency and can further demonstrate this competency is relevant to their high performance level, you can make a pretty strong case that the competency in question is "empirically valid".
In the case of sales positions, for example, if you can show there is a high degree of correlation between sales volume and certain competencies, those competencies are considered to be empirically valid. They are statistically relevant to sales performance. In such cases, you need to be able to show that those who posses these competencies consistently achieve high sales volume (i.e., they consistently beat sales quota). On the other hand, those who lack these same competencies consistently deliver lower sales volume (i.e., they are consistently below quota).
Put simply, to test for the validity of the competency selection model:
Employees who fit the model consistently beat sales quotas
Those who don’t fit the model consistently fall short of quota
Competencies that have been empirically validated are highly defensible from a legal standpoint and can easily be demonstrated to be valid criteria for either candidate selection or employee assessment.
Where possible, therefore, empirically validated competencies need to be identified and added to those that are job-content based to arrive at a final competency model.
Employee Assessment & De-selection Process
When using the competency model for de-selection purposes, it is important employee evaluation be a "multi-rater" process. Preferably there should be 3 or more raters, each having first-hand knowledge of the employees to be rated. This should obviously include the employee’s immediate supervisor and other management personnel familiar with the quality of the employee’s work.
Additionally, where available, the last two performance evaluations for each employee should be provided to the members of the evaluation team, as well as any other performance-related documentation contained in the employee’s human resources file. Also, when using empirically validated competencies, you should have the last two years of measurable performance data available for use in the assessment process. For example, if a sales employee, empirical data might include:
Sales volumes for last 2 years
Sales volume increases for last 2 years (dollars and percentages)
Established sale quotas (if any)
Performance against quota (i.e., percent of quota achieved) for last 2 years
The following process is then recommended for use by the evaluation team in the actual evaluation of employees:
Evaluation team reaches consensus on a uniform employee evaluation scale (usually 1 to 4) based on employee competency level.
4 = Superior level of competency (has few, if any, peers)
3 = Above average level of competency (competency is higher
than most)
2 = Average (acceptable) level of competency
1 = Below average (unacceptable) level of competency
Where they exist, pre-established "behavioral anchors" (i.e., pre-determined performance levels for each competency, along with their respective definitions) should be used in the place of the above general, numerical rating scale.
Team members independently (without discussion) evaluate each employee against the competency model and record their ratings
Independent rating scores are then averaged for each competency, and the employee then receives a final score by multiplying the average evaluator rating for each competency times its pre-assigned weighting.
A "cut-off score" is then established so that it yields the number of employees needed to reach the program’s objective.
The cut-off score is applied and employees whose scores are below the cut-off are identified and placed on a "target list."
Adverse Impact Analysis
Once employees are identified for de-selection purposes, an analysis needs to be performed to determine whether there has been adverse impact on any particular "protected class" employee grouping (i.e., race, creed, color, age, sex, national origin, or disability). Where the percentage of a certain protected class of persons selected for employment separation is disproportionate to that of non-protected classes, the selection process is said to have had an "adverse impact" on that protected class grouping.
In such cases, it is important to identify and closely examine the specific competencies that consistently caused the low rating of the affected class members. Once identified, it is important to verify that these competencies have been appropriately validated, and are therefore legally defensible in the event of lawsuit. Where such competencies have been empirically validated, there should be no problem, and the company can feel free to move ahead with little or no risk.
Although not as readily defensible in a court of law, content-validated competencies need to be more closely examined to be sure they have been properly validated from the legal perspective.
In final analysis, however, where evaluation criteria have been properly validated (either empirically or on the basis of job content), there should be little or no risk of an adverse impact lawsuit being successful. In all cases, such validation should hold up well in court.
Due to the high volume of adverse impact-based lawsuits and the ever-changing legal landscape as molded by continuous court decisions, it is strongly recommended that the entire validation process and results be thoroughly reviewed and blessed by your corporate attorneys or outside legal counsel before proceeding with employee notifications.
Differential Treatment
The rule of thumb, when assessing employees (or employment candidates), is "make sure that you consistently treat all employees the same". Application of certain criteria or reasoning to one employee (or groups of employees) and not to others (i.e., "differential treatment"), is an open invitation to time-consuming, expensive litigation. Where "adverse impact" can give rise to "group" class action lawsuits, "differential treatment" can give rise to lawsuits by "individual" employees who believe they have been "singled out".
The key to avoiding this type of lawsuit is consistent treatment of all employees. If you apply certain criteria, standards, or logic to one employee, make sure you apply the same criteria to all other employees. For example, in de-selection, should you elect to exempt an employee from a large sales loss on the basis "she had no control", make sure to exempt other employees with large sales losses if the same basis and logic should apply.
The best advice is, treat all employees uniformly and consistently and the threat of potential lawsuits on the basis of "differential treatment" goes away entirely.
-
蜜蜂的团队理论
一个蜂群往往能在一个月内由小团队变成非常强大的团队,它们分工合理,责任明确,工作时任劳任怨。我们发现蜜蜂有良好的团队作战精神及顾全大局的思想,但深入了解蜜蜂的人,一定会知道,蜜蜂除了分工不同外,生理上还存在着巨大的差异。工蜂居然没有生育能力,它们每天除了劳...
-
管理寓言:双头鸟的悲剧
从前,某个国家的森林内,喂着一只两头鸟。名叫“共命”。这鸟的两个头“相依为命”。遇事向来两个“头”都会讨论一番,才会采取一致的行动,比如到哪里去找食物,在哪儿筑巢栖息等。有一天,一个“头”不知为何对另一个“头”发生了很大误会,造成谁也不理谁的仇视局面。其...
-
早作准备话培训
细想一下早作培训准备确有其理。一、计划性:培训涉及到企业的方方面面,临时制定计划可能不周全,也较难征得内部其它员工的认可。如一个企业的人事经理想作销售技巧的培训,而销售经理则需要管理经销商的课程,这就不利于工作安排与协调。同时“临时抱佛脚”对年度培训...
-
日本企业文化建设对中国企业的启示
因中日两国社会制度不同、历史文化背景不同、所处历史阶段及企业具体情况不同,对日本企业文化建设的经验必须有选择地加以借鉴。一、中国企业的企业文化建设应做到科学定位、扎实推进,真正促进企业发展。企业文化是一个企业在长期生产经营过程中形成和发展起来的...
相关文章
- Obama's Weekly Address:Closing Corporate Tax Loopholes
- Obama‘s Weekly Address:Celebrating Independence Day
- 英语演讲稿:What College Education Means to Me
- 关于员工心理援助方案(EAPs -Employee Assistance Programs)问答
- 1984 Democratic National Convention Keynote Address大纲
- Obama's Weekly Address:It's Time for Congress to Help the M
- 大学生英语演讲稿 What College Education Means to Me
- 英文求职信-Human Resources - Assistant Personnel Manager
- 精选英语演讲稿最新:What College Education Means to Me
- 1984 Democratic National Convention Keynote Address