You have to download album artwork in iTunes. It probably has the artwork for albums you purchased previously in iTunes but not for other music you already had or downloaded elsewhere. You can set the preference for iTunes to automatically download all artwork but it won't find it if the file isn't named correctly with all the meta data filled out.