Working with a broker that has a poor response time?

For Context: I've been full time searching for 8+ months, have a clear buy box, and a deal team ready to go once the 'ideal deal' comes across my plate. The Problem: I believe that I've found that gem-of-a-deal [about a month ago], my investors think so too, and my QoE/Lawyers are ready to kickoff diligence, but the broker that is managing the business listing has been dragging his feet every step of the process. The broker has a response rate of 6+ days on every email, will not respond to any text, and sends every phone call to voicemail. [For context, from the start of our working together, he voiced that he prefers to work via text, and I have not abused these communication channels having only sent 8 texts in 4 weeks and only called him when he missed a meeting we have scheduled.] My fear is that the deal is going to crumble because of the brokers' poor management. My Question: Has anyone experienced something like this and can shed some light on what may be going on in the broker's process / work day, which causes him to perform this way? Additionally, are there proven methods to keep a transaction moving forward and prevent the deal from dying when working with a broker like this? More Pointed Question: Would it benefit or hurt someone in my situation to reach out to the Seller directly and remove the broker as a bottleneck? [Context: I've had minimal interaction with the seller to date and do not want to hurt the transaction's viability for the sake of moving slightly faster.]