Go to Ban Pakkad instead, it's ~100km from Poi Pet and you can do an in-and-out if you have a multiple entry visa. I did it last month. They might ask for an extra payment on the Cambodian side for getting stamped out immediately. Just make it clear that you already have a visa for Thailand.