legally, you're not required to fly the vector unless you roger up to the heading.
I'm sure you are correct.
I suppose I was actually "over" the Edwards Complex, rather than "in" it. I was above FL600 and was under the control of LA Center, not Joshua Control like you are when "in" The Complex. We have an LOA with the Centers on how we conduct operations above FL 600. Yes, we are technically VFR and out of the Class A. In reality, they continue to try to vector us around if there someone else above 600... which is common in San Fran Center airspace.
On this day, I was testing a sensor on an exercise. The other pilot was Bert Garrison, in what would be one of the last flights of the SR-71. Bert, Ocho (his RSO) and I were deconflicting on UHF, and it was no factor. I told LA Center that but he insisted I turn. My lack of willingness to follow instructions resulted in the ensuing violation. It's been a long time, but I recall it didn't get put to bed for quite a number of weeks... not that they were really bothering me about it. It just took a while.
Anyways, after speaking to the mililtary liaison, I never heard another peep.
Side note: Bert was the last AF pilot to qualify in the Sled. I think he only got about 50 hours when they retired it in '97.
He subsequently came to the U-2.