Hanging lights on branches. Go natural with a fat branch and hang a combination of ornaments and candles attached with wire. Use twine or strong fishing wire to suspend the branch from above. You might want to try hangers so as not to damage your ceiling.
Display bits of fabric that you like instead of keeping it in a box. Fabric is art in itself. You can find embroidery hoops all the time at garage sales and thrift shops! Maybe even paint the hoops to give a little color to the fabric hoop wall!