A borrower who complained that his mortgage adviser wrongly charged him $2500 when he changed banks has been told the broker acted appropriately.