Yes, I didn't say you have to fly directly to the island, you can just fly to Samui and take the boat from there, which is fast and straightforward.
As for why not Samui, because Samui is more busy usually, and the staff there are quite confrontational (the short haired lady who does the initial document check likes to argue a lot). I don't see much reason to pick Samui over Phangan personally. Don't see how any of that was bad advice, if you wanted the office that was just absolutely fastest to get to then clearly the answer is neither Samui nor Phangan, but your local office.
Do you have a link to the report of problems? The only problems I normally saw at Phangan were with people trying to apply too long before their expiration, or wanting the 60 days when they hadn't done the 30 day regular extension first.