We develop and study sequential testing procedures á la Chu et al. (1996) for on-line detection of changes in a time series from stationarity to mild forms of non-stationarity. The proposed tests are based on sequential CUSUM and KPSS-type detector processes, and are shown to provide consistent detection under a wide range of change point models, including changes in the parameters of ARMA and GARCH series from values within the model’s stationarity parameter region to values close (converging)