Sounds like when I was there, except when fish were being caught they were big. One guy landed an 18 pounder in a boat next to me and many guys said they had landed 20 pound plus fish in the last few days, but action was slow.
Did you get the two small ones in the morning? I got there way too late for the good fishing a couple weeks ago.
Even if the lakers aren't biting now, the browns are ripping spoons in the lake fork inlet near the riprap at the bridge. If you anchor parallel to the banks and slowly reel in a daredevle, I bet you could nail 50 browns a day, and some of these browns, lots of them in fact, have been four pounds or better. I had a brown that was at least 24" follow my devle up to the boat and snap at it as I lifted it out of the water.