My computer has AOL and IE installed onto it. .html and .htm files were associated with AOL, opening them with AOL. I didnt like that. I changed it so that those two filetypes are opened by IE, but, the files still have the AOL icon. How do I change that? I am on Windows XP.

Open up My Computer then Tools/Folder Options File Types tab select HTML files then click advanced.