If you already have speakers you could replace the full size amp with a mini amp.
A stylus upgrade for the LP60 from conical to elliptical is LP GEAR CFN3600LE $29 or with a new belt $39.
DIY is what I do... here's what I would part together for a $150 budget.
SMSL 2x50W Amp: http://www.amazon.com/SMSL-50Wx2-TDA7492-Amplifier-Adapter/dp/B00F0H8TOC
Dayton B652 Speakers: http://www.amazon.com/Dayton-Audio-B652-Bookshelf-Speaker/dp/B002RMPHMU
5A Battery: http://www.hobbyking.com/hobbyking/store/uh_viewItem.asp?idproduct=16770.html
Instructions: http://imgur.com/a/Qgmay
This would be better than anything else for the price!
Yeah it's crazy the little details we think are super important when getting into a hobby that seem to be pretty unimportant later on. I had a Lamy Safari as my first pen, but going into it I thought that the snap cap would be a huge issue. I thought it would be super loud or annoying to put on and off or something like that. Turns out it's not even a problem now that I've got the pen lol.
That pentel looks awesome! I really like the simple and classy look of it. That's a big reason I like the Lamy 2000. It looks like a black pen at first, but is much cooler once you really look at it.
Honestly with speakers, cheap stuff is a lot more fun that expensive stuff to me. I've got a pair of Quad Z-3 towers. Yeah, of course they sound good. If they cost that much and don't, there's a big problem. The thing I like about cheaper speakers is how they all have a very fun character. Once you're spending a lot of money, every speaker out there just tries to sound exactly the same. Cheaper speakers do different stuff though. There are some speakers that focus on midrange, so vocals sound really sweet and warm. There are some that focus on the top end, so you get every little detail up top. There are some that focus on dynamics, so you get that "front row of a concert" sorta feel. I like experimenting with all that stuff. It's just fun. And you don't have to spend a ton of money and get those KEFs to really get into it.
Just for fun, I'll build a cheap setup for you, so you'll know what to get in the future if you ever feel inclined haha.
The Micca MB42X are really the "go-to" starter speaker. They're one of the cheapest that sound decent. And, honestly, they sound really good.
SMSL SA50 to power them. That's on sale for the same price as the SA36 right now. They're the same thing, just this has more power. You don't need it, but you might as well have it haha.
Some speaker cable. You need to cut it and strip it to put it into the speakers. There are quite a few tutorials out there on it. It's pretty easy.
Boom, just like that you've got a sweet stereo speaker setup that will blow any single speaker out of the water, and easily impress anyone! It comes to around $150 with everything.
I'm not trying to talk you into anything, but I'm basically pointing out that you don't have to spend thousands of dollars to get a respectable system.
While we're on this, another thing I like about hobbies is that anyone can be in it at any price range, and that's super cool to me. If someone only has money for a $15 Pilot fountain pen, who cares? That's awesome that they like fountain pens! They don't need to have a $200 fountain pen to be cool. Just anything is sweet. Same with speakers. You don't need a multi thousand dollar system to be "into audio" or whatever you'd call it. If you've got a setup that you like, at whatever price, that's sweet! I'm glad we both enjoy music.
What's your budget for the amp? The SMSL SA-50 is excellent, and its little brother the SA-36 isn't bad, either. The Lepai LP2020 is also super popular, and they seem pretty reliable, although I don't think the sound quality matches the SMSL ones.
Most of those look like they're less powerful than the Pyle you were looking at, but that's because Pyle uses some very creative math in their marketing. If you look at the spec sheet, that PTA4 is actually good for less than 20 watts per channel, making it weaker than any of the stuff I've recommended. Also, those drivers are fairly sensitive and it's unlikely you'll need more than a couple watts.