Is listening without paying attention a good idea? I find it hard to focus

I’d start with shorter listening sessions that allow you to focus for the whole time. As you improve in the language, you’ll be able to focus for longer.