Well I had on a hoodie and jeans and felt under dressed
Casual is accepted.
Most of the patrons are dressed up but there were a few wearing jeans as well. I don't think they would turn anyone away as long as they are dressed respectfully. You may want to contact the restaurant directly though if you're concerned about them imposing a dress code.
Get quick answers from Le Baccara staff and past visitors.