The system for managing applications for asylum came close to collapse last year as senior officials warned backlogs were quickly reaching "unmanageable levels".