In certain parts of Japan more than others, the people are actually pretty accepting of foreigners who at least put in an effort to speak Japanese or follow the customs. They might laugh or make fun of you a little bit, but they wouldn't be outright mean to you and would probably do their best to help you.