The timer while the lobby gets filled is a problem. When the timer runs out and there are not enough players in the lobby, the matchmaking throws out all players and starts again. Here is my suggestion:
The timer only starts when enough players are in the lobby. It is halved when half of the players in the lobby pressed "ready".