Data released by the Mortgage Bankers Association confirms the trend that prime borrowers are the ones to worry about.