Well...don't read too much into what I posted before. Keep in mind I was commissioned nearly 10 years ago during a period when aviator was termed "undermanned" and NFO was "critical." There was no such thing as competition for SWO. All new commissions except for OCS were unrestricted line officers, period. The only guys who were truly required to have calc/physics and do well in them (besides USNA/scholarship mids) were nukes (all sub guys and a few surface). That said, keep your GPA in mind. If your program requires the classes, then obviously you'll need to take them regardless of your preference. However, if you have to pick between struggling with classes and grades should you not be a brainiac (I for one just chose not to take them since my major didn't require them and GI Bill was paying for school), then you may want to lean toward a better GPA. It won't matter if you're a nuclear physics major w/ a 2.3 average. If it comes down between you and another qualified candidate w/ a 3.4 in interpretive dance, well if they meet all the other requirements, you might lose out.
What I'm saying is, if you're good at it and can do it, then by all means take the classes as they'll definitely make you smarter like Steve said; but if it's not a requirement for your program, I wouldn't intentionally make life more difficult for yourself. Again, between two equally qualified candidates who meet the established requirements, if the only real discriminator between the two is GPA, then the GPA will likely be the determinant. They do expect that you won't be a dim bulb; but that aside, the Navy will really teach you what you need to know about your job. If they can turn music majors into bona fide legitimately good Top Gun instructors (it's true), then they can teach you anything.