Also, pick up a copy of Charlie Papazian's book, The Complete Joy of Homebrewing. Best introductory book you'll get. There are a lot of other great publications that are good should you stick with it and get more advanced. I will even send you my copy (if I can find it).

Mule's advice is very good. Only thing I can really add is that if you go get plastic buckets at a hardware store, make sure that they are "FOOD GRADE". This is important. Later on, if you really get going, you can invest in glass carboys.