Almost 4,000 courses have been scrapped at UK universities in the past year, figures show, as institutions struggle to balance the books and students baulk at the cost of gaining a degree.