Feelings on the High Street are mixed as unrest continues over a local hotel housing asylum seekers.