You are in DE, correct? There are some discount brick and mortar stores in Philly (not to mention NYC) that also carry inexpensive wool fabrics. I am more familiar with the New England fabric situation (or the DC fabric scene) and can't advise specific stores in Philly or Delaware. But I used to live near some jobbers (they sell offcuts, mill ends, stuff from designers and manufacturers and often get their stock in NYC) with a brick&mortar store that had all woolens for $5, wool/cashmere blends for $7, including the really high end stuff - there are probably some similar jobbers in the Philly area.
I have been to JoMarr in Landenburg, and I know there's also one around I-street in Phily. They were really great as fas as prices go, (especially because I caught them during their huge summer sale with 4$ a yard 100% linen of all weights. That ruled) it's just a matter of motivating myself and finding a day to drive up there.