Amaya is a fairly popular open source WYSIWYG editor. -link- KompoZer is another, never tried it myself and it looks pretty basic but it might be worth a try. -link- Quanta Plus is another fairly simplistic style editor, it was my preferred editor before I learnt proper coding though. -link- If you want a really beefy bit of software enriched with a mixture of features then I'd recommend taking a look into Microsoft Visual Web Developer 2008 Express (the express editions of their software are free for non-commercial use). -link-
Yep, KompoZer, Notepad and FileZilla. Learning to do it all in Notepad will give you the cleanest results as WYSIWYG editors tend to freak and dump unnecessary code into a page. I'll sometimes use KompoZer at the start of a project to see what all the elements are doing before moving to notepad and adding PHP specific stuff.
For html you can use Kompozer and for FTP. But if you want to get serious with html invest in Dreamweaver. Its not that expensive and really really good edit: Silver beat me to it
My favorite editor is Bluefish, But Linux is my thing This is a good context editor and can be used for all sorts of editing, HTML, PHP, SQL, C etc. Can even cope with linked HTML CSS files and links into Firefox and possibly other browsers to view output May even do a windows version but that doesn't interest me.