In regedit, goto:
And in right-side pane, u can delete the URLs u want
The Windows Registry is a database which stores settings and options for Microsoft Windows operating systems. It contains normally information and settings for hardware, operating system software, most non-operating system software, and per-user settings. Registry is used to optimize the security, enhance the functionality, modify the functioning of any software OR settings and many more.
In this blog I have tried to collect all the tweaks and hacks available on various website. I have tested many of these hacks before posting but still I would suggest you to take backup of your registry before trying any of these tweaks and if anything goes wrong while trying these hacks I or this blog will not be held responsible.