Look in Anacortes or even Mount Vernon/Burlington. I know plenty of people who make that commute, and then you're not "stuck" on the island.
Generally the closer you are to 5, the easier Seattle, B-ham, and Vancouver become on weekends, because you don't hit the "oh fuck it; it's not worth driving that long" phase as early in the day. Balance this with how long you're willing to haul your ass into work and househunt accordingly.
Mount Vernon's about a 45 minute-ish drive. I've known people who've lived in Everett, Marysville, or Bellingham, but IMHO, that's an effing insane commute.
Oftentimes the Everett/Marysville people are compromising a heinous commute with a spouse. They go north, and spouse is forced due to their job to go south and fight the unadulterated hell that is Seattle/Bellevue rush hour.