I was stationed at Pt. Mugu, but lived just out the back gate of Port Hueneme. Fantastic place to live. I was on Lake Shore Dr. right next to the Coast Gurad station, but that entire area was great. Little hole in the wall bars scattered throughout the neighborhood, a couple of restaurants, the BEACH, etc. The real action is in Ventura, Malibu, Thousand Oaks, but I loved living there. I later moved to Camarillo, and was not nearly as impressed.
Can't speak to Gulfport, but, since rednecks are generally "my people", I won't speak ill of them.