Regular examination of the statistical accuracy of the Tankan
February 18, 2011
Bank of Japan
The Bank of Japan examine the statistical accuracy of the Tankan (Short-Term Economic Survey of Enterprises in Japan) once a year, to prevent a decline in the statistical accuracy due to a decrease in the number of sample enterprises caused by bankruptcies, mergers, and other factors. We add new sample enterprises to the Tankan when the examination shows that statistical accuracy has declined. The result of the recent examination showed that the statistical accuracy of the latest survey (December 2010) met the standard. As a result, the total number of the sample enterprises for the March 2011 survey will be 11,302 (including 201 financial institutions).
Details of the examination are as follows.
1. Sample Distribution
Population enterprises are classified into 397 strata by industry, scale based on capital size, and number of regular employees to calculate the population estimate.
For each stratum subject to the sample design,1 we examined whether the distribution of the sample enterprises properly reflected that of the population enterprises. The result showed that there was no stratum in which the distribution of the sample had deviated from that of the population.2
- Strata with less than five enterprises (49 strata) were excluded.
- The "test of the goodness of fit" using chi-square distribution is used in the regular examination. This method tests the null hypothesis, H0: "The distribution of the sample and that of the population have the same shape." When the hypothesis is statistically rejected, it is judged that a deviation exists between the distribution of the sample enterprises and that of the population enterprises.
2. Error Ratios of the Population Estimates
For all of the six main categories (manufacturing and nonmanufacturing for large, medium-sized, and small enterprises, see below), the error ratios of the population estimates3 (measured by sales data) remained within the target range (3 percent for manufacturing and 5 percent for nonmanufacturing).
- 3Population estimates based on sample surveys, such as those in the Tankan, inevitably entail certain estimation errors, and this should be taken into consideration when the data are used.
Inquiries
Business Survey
Research and Statistics Department Bank of Japan
E-mail : post.rsd5@boj.or.jp