Something like this in there may make a world of difference: https://www.amazon.com/Post-Audio-ARF-05-Reflection-Mounted/dp/B00AQDLMSA
Used or cheap mattresses also help, so do carpets. What are you currently using? You can buy sound dampening window curtains at Bed Bath & Beyond