Bring food with you as there is a small kitchen. Rent a car from Bud's if you will be there for more than a day.
We enjoyed three nights at Aimee's Guesthouse, and highly recommend it. It's a beautiful location. We benefited from the laundry facilities, and enjoyed meeting and chatting with Aimee. We found it helpful to get a rental car, because Gustavus, although small, is spread out.