shassouneh:
1. Under Add/Remove programs, choose Add/Remove Windows COmponents in the sidebar. Uncheck Internet Explorer. This will "remove access from the Start Menu and Desktop." Open your other browser and say yes, you want to set it as the default browser.
IE will never open again unless you specify so.
2. To completely remove all traces (except an empty folder): Back up your files. This will require a reinstall.
Use the method detailed at vorck.com.
Last I checked this wouldn't work later than Windows 2000.
But it is the best for reducing Windows to only its necessary core files. For XP:
nLite: http://nuhi.msfn.org/
3. For Windows Update: Daisy http://vtntug.w2k.vt.edu/daisy.htm
There are a few bugs in this program, but it is the best. All bugs are documented and can be fixed manually, you just have to read all documentation very carefully. Or:
windizupdate.com.
I have happily been working completely without IE for over a year.
