Oil whip induces self-excited vibration in fluid-handling machines and causes self-excited reverse precessional full annular rub, known as "dry whip", which is a secondary phenomenon resulting from a primary cause, that is, "coexistence of oil whip and dry whip". For predicting these instabilities, the clues are hidden in start-up vibration signals of these kinds of machines. This paper presents a method for predicting these kinds of instabilities. First, a Hilbert spectrum combining a full spectrum, which is named the "full Hilbert spectrum", is developed to reveal the whole process. Next, the transient position of a shaft centerline combining an acceptance region is introduced to predict instability at an early stage. The results presented in this study amply demonstrate the transition from stability to instability and the behavior of fluid-induced instability and rub in rotor systems. By this finding, bearing designers can completely understand these instability phenomena existing in fluid-handling machines. As a result, the control parameter for designing controllable bearings can be obtained and the instability problems can be resolved. Consequently, these findings are worth noting. (C) 2011 Elsevier Ltd. All rights reserved.