A wire hanger with clothespins or curtain holders is a great solution to save space and store the caps.