I'm sorry to say this but from my experience, accessories really are the only way to manage hair and keep it out of your face.

If you're looking for a hair tie that won't rip out hair or feel uncomfortable, I recommend spiral hair ties like these (link is for illustration only, you can probably find these at a local store). You can also use scrunchies. Both types of hair ties are my favorites and feel much more comfortable to wear than the alternatives. Plus, you can usually keep one on your wrist like a bracelet so you only have to use it when you need it (like when you're eating).

If you're like me and you need hair to frame your face to hide a strong jaw, you have to get creative with how you tie your hair. Usually I just take bits from the front and tie them back. It's a really cute look and gets hair out of my face. (I would take a picture to illustrate but I want to keep this account anonymous, sorry.)