How to delete course from this section?

You can’t remove a complete course from the Playlist at the moment. You can only remove one track at a time.