Yeah, they can be brutal, but with most medical issues, the rule of thumb seems to be: is it causing you pain or restricting your mobility? Is it an ongoing or recurring condition? Will it impair your ability to fly (operate all the controls, pull G, valsalva, eject, etc) or go on deployment? If "no" to all of the above, you're pretty much good to go.
Kidney stones are an issue for the Docs because if you've had them once, you can get them again and they can reoccur without warning.
If you've made a full recovery from your broken wrist and have no movement issues, then bring all your paperwork but I can't see it'd be an issue. I went through the VT's with a guy who was missing his pinky (childhood farm accident). He said the Docs just kinda shrugged and said they couldn't think of anything you'd need your pinky for in the plane anyway.