No, but you might have to charter your own boat which will cost 800 baht (for the boat, not per person) rather than the 100 baht per person it would have cost in the regular shuttle boats.
Definately budget for the private boat. Very unlikely you will get the cheaper boat that late at night. We had to pay 1000 baht for a boat. Ten times the 100 baht for a regular boat. Other option is to change your hotel to one in Ao Nang.