Cozy inns and B&Bs are great options for accommodations in the Marigny or Bywater. You’ll get a true neighborhood feel in these guest houses with courtyards, gas lamps, and gardens.