Benefit Accuracy Measurement Program (CY 1998)
The Benefit Accuracy Measurement (BAM) program (before 1996 called Benefits Quality Control) is designed to determine the accuracy of paid intrastate claims in three major Unemployment Insurance (UI) programs. It does this by reconstructing the UI claims process for samples of weekly payments using data verified by trained investigators.
For claims that were overpaid or underpaid, BAM determines the amount of benefits the claimant should have received, the cause of and the party responsible for the payment error, the point in the UI claims process at which the error was detected, and actions taken by the agency and employer prior to the payment that is in error. BAM does not estimate all underpayments, because it samples only payments, not denied UI claims.
Coverage
BAM covers the three largest permanently authorized unemployment compensation (UC) programs: State UI, Unemployment Compensation for Federal Employees (UCFE), and Unemployment Compensation for Ex-Service Members (UCX). These three programs account for over 92 percent of the UC benefits paid. BAM data are available for the 50 States, the District of Columbia, and Puerto Rico from January 1988 through the present.
Sample Design
State BAM samples are randomly selected from the population of UI, UCFE, and UCX payments issued by the State each week. BAM refers to this weekly sampling interval as a batch. Each batch begins at midnight Sunday and runs until 11:59 p.m. Saturday. BAM records the number of UI weeks and dollars that were paid in the population from which the sample was selected so that the sample data can be weighted to make inferences concerning the population.
Sample Sizes
Before 1997, BAM sample sizes ranged from 400 to 1800 cases per year per State. Since 1997, allocated sample sizes range from 360 cases per year in the 10 States with the smallest UI workloads to 480 cases in the remainder of the States. Several States have chosen to select larger samples.
Database
The BAM database includes about 110 data elements for each sampled payment. Data for 15 of these elements are captured twice (before and after the investigation), and eight are completed only for payments containing errors. Aggregate data for each batch are collected for an additional 42 data elements, most of which are demographic characteristics of the sample and population.
Methodology Considerations
Estimates based on BAM data are subject to the usual sampling and non-sampling errors that can affect survey data. BAM has implemented several quality assurance procedures to minimize non-sampling errors, such as incomplete or improperly defined sampling frames, errors of interpretation and data entry errors. Nonresponse bias is not significant. Nationally, BAM program staff gather sufficient information from claimants, employers and third parties to complete their investigations for over 99 percent of the UI payments that are sampled; sample case completion rates are 100 percent in most States. When the program began, all BAM verifications were done in person. Since 1993, investigators may use telephone, mail and fax methods as well. UIS studies have shown that although such methods yield somewhat less information than in-person contacts, the overall payment accuracy rate estimates are not significantly affected.
In reconstructing each sampled payment, the BAM program retroactively investigates the accuracy of the UI claim's monetary and separation determination, as well as all information relevant to the payment that was sampled, including the claimant's efforts to find suitable work, ability and availability for work, and earnings from casual employment or other income sources, such as pensions. It also records demographic, UI program, and labor market data on each claimant. BAM does not maintain longitudinal data on the claimant's UI benefit history subsequent to the compensated week sampled.
Although claimant characteristics can be inferred from the data, it is important to keep in mind that the BAM sampling frames consist of payments. Claimants have an increased chance of selection to the BAM samples the longer they remain in the UI system and are paid benefits. Estimates of claimant characteristics that are correlated with duration of receiving benefits are subject to bias unless they are weighted to take into account the claimant's probability of sample selection.
Published Findings
The Department of Labor has published annual data by State along with supplementary analyses since 1988. From 1988 to 1995, the report is called the Unemployment Insurance Benefits Quality Control Annual Report; 1996 data are in the UI Benefit Accuracy Measurement Annual Report. Since 1997 BAM data are part of the UI PERFORMS Annual Report, which also includes data from the Benefit Timeliness and Quality program and the Tax Performance System.
Calendar year 1998 BAM program data are summarized in the following table. Overpayment and underpayment rates are estimates and do not represent the actual percentages of errors detected in the population. These estimated rates are subject to sampling and nonsampling errors. The 95 percent confidence intervals for each State's overpayment and underpayment rates equal the estimated error rate plus and minus the value indicated in the column (+/). The true error rate is expected to lie within this interval for 95 percent of the samples of the size selected by the State. The 26,353 UI payments for which data were collected represents a completion rate of 99.9 percent of the cases sampled in 1998.
A compendium of this data is available in the CY 1998 UI PERFORMS Annual Report. This report also includes data from the Benefit Timeliness and Quality and Tax Performance System programs. Printed versions of the report are available through the National Technical Information Service (NTIS) (Internet: www.ntis.gov). Orders through the NTIS may be placed by telephone (1-800-553-NTIS (6847) or 703-605-6000), fax (703-605-6900), e-mail (orders@ntis.fedworld.gov), or mail (NTIS, 5285 Port Royal Road, Springfield, Virginia 22161). The printed version does not include optional State narratives which address the BAM results.
Readers are strongly cautioned that it may be misleading to compare one State’s BAM overpayment and underpayment rates with the rates of other States. No two States’ written laws, regulations, and policies specifying eligibility conditions are identical, and differences in these conditions influence the potential for error. States with stringent, complex provisions will tend to have higher overpayment rates than those with simpler, more straightforward provisions, for example. No performance standards for UI benefit accuracy have been established.
Contacts
|
Andrew Spisak Mathematical Statistician Division of Performance Management Office of Workforce Security (202) 693-3196 aspisak@doleta.gov |
-OR- |
Burman Skrable Team Leader, Data Analysis and Validation Division of Performance Management Office of Workforce Security (202) 693-3197 bskrable@doleta.gov |
| UI Benefit Accuracy Measurement Report -- CY 1998 | ||||||||
|---|---|---|---|---|---|---|---|---|
| State | Sample | Amount Paid* |
OP Rate |
+ / - | Amount OP* |
Up Rate |
+ / - | Amount Up* |
| AK | 481 | $92.77 | 7.46% | 2.37 | $6.92 | 1.37% | .55 | $1.28 |
| AL | 702 | $211.51 | 7.53% | 1.90 | $15.92 | .63% | .37 | $1.33 |
| AR | 479 | $173.59 | 7.74% | 2.58 | $13.44 | .54% | .30 | $.93 |
| AZ | 480 | $123.75 | 10.73% | 3.05 | $13.28 | .35% | .29 | $.44 |
| CA | 1,729 | $2,518.27 | 5.90% | 1.16 | $148.57 | .55% | .17 | $13.92 |
| CO | 480 | $142.32 | 12.76% | 3.07 | $18.17 | .62% | .40 | $.88 |
| CT | 481 | $308.50 | 2.85% | 1.34 | $8.78 | 1.31% | .85 | $4.05 |
| DC | 360 | $56.68 | 11.78% | 3.30 | $6.68 | 1.51% | .82 | $.85 |
| DE | 480 | $55.79 | 12.64% | 3.27 | $7.05 | .70% | .40 | $.39 |
| FL | 481 | $598.24 | 6.58% | 2.42 2 | $39.35 | .67% | .48 | $4.0 |
| GA | 480 | $239.46 | 3.68% | 1.69 | $8.82 | .35% | .30 | $.84 |
| HI | 481 | $137.88 | 2.50% | 1.31 | $3.45 | .24% | .15 | $.33 |
| IA | 480 | $156.37 | 8.11% | 2.53 | $12.68 | 1.14% | .88 | $1.7 |
| ID | 483 | $97.00 | 12.48% | 3.01 | $12.10 | .67% | .52 | $.65 |
| IL | 613 | $1,088.07 | 11.09% | 2.43 | $120.65 | 1.29% | .50 | $14.02 |
| IN | 690 | $253.09 | 14.89% | 2.83 | $37.69 | .40% | .36 | $1.02 |
| KS | 492 | $128.19 | 11.67% | 2.83 | $14.96 | .03% | .05 | $.04 |
| KY | 484 | $215.80 | 5.03% | 1.92 | $10.85 | .46% | .24 | $.99 |
| LA | 520 | $136.73 | 9.70% | 2.63 | $13.27 | .64% | .31 | $.87 |
| MA | 579 | $720.33 | 4.28% | 1.63 | $30.83 | 1.58% | .71 | $11.36 |
| MD | 485 | $287.36 | 22.72% | 3.85 | $65.30 | .38% | .22 | $1.08 |
| ME | 488 | $80.73 | 22.08% | 4.21 | $17.83 | .61% | .60 | $.49 |
| MI | 480 | $924.30 | 13.28% | 3.24 | $122.71 | 1.98% | .58 | $18.27 |
| MN | 480 | $335.39 | 9.11% | 2.67 | $30.56 | .33% | .17 | $1.11 |
| MO | 480 | $249.79 | 5.91% | 2.04 | $14.77 | .28% | .19 | $.69 |
| MS | 480 | $104.99 | 8.71% | 2.57 | $9.14 | .27% | .19 | $.28 |
| MT | 360 | $53.11 | 16.76% | 4.02 | $8.90 | 1.31% | .70 | $.69 |
| NC | 768 | 391.67 | 9.83% | 2.20 | $38.50 | .67% | .33 | $2.64 |
| ND | 364 | $27.95 | 2.25% | 1.57 | $.63 | .22% | .17 | $.06 |
| NE | 363 | $42.04 | 7.05% | 2.55 | $2.96 | .56% | .57 | $.23 |
| NH | 382 | $22.00 | 6.93% | 2.68 | $1.52 | 1.15% | .69 | $.25 |
| NJ | 471 | $1,043.51 | 6.05% 1 | 1.95 | $63.12 | 1.23% | .39 | $12.8 |
| NM | 480 | $78.50 | 5.87% | 2.27 | $4.61 | .14% | .13 | $.11 |
| NV | 480 | $154.65 | 13.05% | 3.16 | $20.19 | .63% | .42 | $.97 |
| NY | 492 | $1,592.76 | 4.58% | 1.97 | $72.88 | 2.02% | .58 | $32.21 |
| OH | 485 | $637.28 | 17.55% | 3.45 | $111.83 | .96% | .31 | $6.11 |
| OK | 480 | $94.78 | 3.79% | 1.72 | $3.59 | .30% | .24 | $.29 |
| OR | 504 | $386.12 | 7.08% | 2.12 | $27.35 | .82% | .41 | $3.15 |
| PA | 480 | $1,421.24 | 4.88% | 1.81 | $69.38 | .46% | .29 | $6.56 |
| PR | 480 | $241.64 | 8.56% | 2.60 | $20.69 | 1.12% | .41 | $2.70 |
| RI | 480 | $125.30 | 4.94% | 2.39 | $6.19 | 1.67% | 1.04 | $2.09 |
| SC | 497 | $164.74 | 11.94% | 2.84 | $19.67 | .38% | .27 | $.62 |
| SD | 360 | $14.18 | 4.67% | 2.50 | $.66 | .66% | .41 | $.09 |
| TN | 480 | $323.40 | 5.05% | 1.86 | $16.35 | .37% | .24 | $1.19 |
| TX | 468 | $876.81 | 14.06% | 3.24 | $123.29 | .56% | .40 | $4.89 |
| UT | 362 | $83.30 | 15.46% | 3.80 | $12.88 | .65% | .28 | $.54 |
| VA | 519 | $171.34 | 19.22% | 3.51 | $32.94 | .30% | .17 | $.52 |
| VT | 392 | $40.59 | 6.53% | 2.36 | $2.65 | .56% | .32 | $.23 |
| WA | 538 | $757.30 | 11.54% | 2.89 | $87.39 | .63% | .31 | $4.81 |
| WI | 480 | $467.67 | 7.84% | 2.58 | $36.68 | .69% | .35 | $3.22 |
| WV | 480 | $125.22 | 1.67% | .98 | $2.10 | .52% | .28 | $.65 |
| WY | 360 | $24.10 | 10.05% | 3.37 | $2.42 | .32% | .20 | $.08 |
| US | 26,353 | $18,798.09 | 8.47% | $1,593.14 | .90% | $169.66 | ||
* In millions of dollars
Source : Office of Workforce Security Division of Performance Management