“Twist and Shout” tension rods might work. They have a lip on them to keep them secured to a smaller space. Only caveat is that wherever you’re securing them to has to all be the same height. If you have any molding that is a different height around the window it won’t work.

There are also command type curtain rod adhesive hooks like this.Probably only best for light weight curtains.