A chalk bucket if you plan on going outside much. To me, chalk bags for bouldering are good for long traverses and what not, but I really like using a bucket outside, and even at the gym. There's no point in wearing a chalk bag for a 10' boulder problem, especially if you bail and land on your toosh--poof! goes a good amount of your chalk onto your crash pad. So, since you aren't going to wear the chalk bag, the only other place to put it is on the ground, where it inevitably turns over (because it's made to be worn) or gets accidentally knocked over, and you end up losing even more chalk. Buckets are made to sit sturdy and safely on the ground. -- $25-$30
Another must is a hand/forearm trainer, I like this one for fingers a lot. You can choose from three different amounts of resistance (soft, regular, firm), and unlike most forearm trainers, this one allows you to train the muscles used to spread your fingers apart. It's great for warming up your hands/arms on the way to the boulder-field, and will really come in handy in avoiding injury. It does less to strengthen your forearms though, so maybe this one for actually building some forearm strength.
Good luck! And where are you, anyway?