My guess is sympathetic response and adjacent fears (an axe murderer might not attack you, but a fear of a “strange” neighbor could be unnecessarily exacerbated)

Anecdotally, I know a few immigrants that learned English through TV at a later age. If you’re interested, don’t let your age hold you back!