Mortgage brokers are dropping because they can't get the rates and underwriting that retail LO's have and so they can't compete.  So far, small agents seem safe except for those that produce less than 10k or in some markets 25k.  Underwriters are dropping them.  That will clean out small fry ABAs anyway.