The last "ultimate collection" was Seekers of Adoulin, and was only available as a physical copy for XB360 for $200 USD.

I've searched for as many of the game boxes as I could on Amazon, you might find them at your local game store. Hope this helps get you started.

PS2

• Original Game Bundle + Rise of the Zilart Expansion $35-$80 USD
• Chains of Promathia $11-20 USD
• Treasures of Aht Urhgan $5-30 USD
• Wings of the Goddess $5-$30 USD
• Seekers of Adoulin available in JP only, last expansion on physical media for PS2
• The Vana'diel Collection 2008 $15-$100 USD

XB360

• Game + first 3 expansions $5-65 USD
• Wings of the Goddess $5-$20 USD
• Seekers of Adoulin $15-$20 USD
• The Vana'diel Collection 2008 $15-$100 USD
• The Ultimate Collection (2009) $85-$150 USD

PC

• Game + Rise of the Zilart Expansion $10-$50 USD
• Chains of Promathia $5-$20 USD
• Treasures of Aht Urhgan $5-$20 USD
• Wings of the Goddess $10-$20 USD
• Seekers of Adoulin (digital download only) $20-$40 USD
• The Vana'diel Collection 2005 $7-$20 USD
• The Vana'diel Collection 2007 $10-$20 USD
• The Vana'diel Collection 2008 $15-$100 USD
• The Ultimate Collection (2009) $85-$100 USD, this is the last physical collection for PC
• Ultimate Collection Seekers Edition (digital download only) $29-39 USD

EDITS: formatting