When I backup attachments, do all images somehow backup within that .zip.tar backup file I download or what?
^ sorry, where do you see attachments backup facility ?
if you take site's backup from the server then
that should contain all folders & their contents