This paper considers the sampling distribution problem of the least squares estimator for the parameter of some special autoregressive models. The Edgeworth approximation has been derived and a modification is proposed to improve its accuracy. Comparisons with the exact distribution and the so called Edgeworth-B approximation have been discussed. The results show that the proposed approximation performs more accurately than the Edgeworth-B approximation, especially, when models are close to the non-stationary boundary.
