He may or may not not know about SMIBs but I do... and I also now realize Milton is the Lexington Park of the Gulf Coast. Thanks US Navy!
If you like living in the sticks, Pax River is for you. Although they've built up the area around Lexington Park in the last few years, the vast majority of the county is still very rural. I still remember moving back there and being pissed off that there are portions of the county where you can't get pizza delivery, cable TV, etc.
The base itself is well maintained, the commissary and exchange are both relatively new. There's a lot of nice outdoor assets there as well, trails, boat ramps, etc. There is a Del Taco, I've seen it.
If you want to get shot, go up to Waldorf (my buddy is a Charles County cop and says things have gotten really bad up near the mall lately)... and if you want to shoot yourself in the foot, live way up north of the base and fight all the Rt. 4/5/235 traffic every day. BTW... Calvert County is nicer than St. Mary's.