My first rod and reel came from walmart, costed about $30 and came with line, backing, tippet, and a few pretty worthless flies. I used that combo for 4 years and caught some of my biggest and smallest fish on it, that rod worked great! Flies will cost a bit to get started since you don't have any. I suggest you ask here what flies to use when you have your rod and reel and a place picked out to go fish. If you don't get enough info here you can ask fly shops close to the rivers and usually get some good enough information since they are there to sell you flies after all
Reels, since you don't know if you'll like it or not, do not spend much money. Find one at walmart, sports authority, or anywhere, I'd just get one that's cheap.
Don't forget boots and waders, unless you don't mind tolerating pretty cold water. Get breathable waders unless you like to sweat.
There's a partner section on here, lots of guys fish alone and would be more than willing to show you the ropes.
It does take a little investment to get into but if you end up liking it then it's worth it, if not at least you tried.