At what point in moving in process do you pay the broker?

I was planning to pay once rent agreement is done but my broker is asking for payment just after paying token. I don’t want him out of the loop to ensure the flat setup is done properly.