You could knit the Lion Brand part, felt it, then pick up and knit the remainder. If you're already into the Silk Garden section you could possibly hand-felt, but needle felting would probably be more accurate.
Just be sure you don't over-felt. I just ruined 3 oven mitts (didn't watch the felting time close enough) and now they won't even go on my hand. waaah!