I started weaving about 2 years ago with a Kromske Harp Rigid Heddle loom. it is very simple and TONS of fun! there are a few books about weaving with a rigid heddle loom out there that would help you with some more "advanced" type weave structures. I've stuck with the simple over one, under one plan that doesn't stress my brain
My other looms are a Spriggs 7ft adjustable triangle loom, a 12 inch triangle and a 12 inch sqauare loom. I really love the simplicity with these looms. I have made some beautiful gifts with them. the 7ft tri-loom does take up a lot of space when in use, but the 12 inch looms are great take alongs. I can now weave on road trips (with the husband driving of course). i got the small ones from Hazel Rose Looms and the 7ft one is from Hill Creek Fiber Studio.
You could also try searching for a weaving/spinning store in your area that might offer rentals so you could try different looms to see what you like before you buy. also try searching for a weaving guild. my guild offers rentals plus the added bonus of tons of people who love all things fiber related and are great to call on when I can't figure out what I'm doing
If you live near NW Indiana let me know