Void Ray/Zealot Rush?

As a toss player, it makes me sad since i can't ever really use void rays, so i started trying to use them in a 2stargate rush supplemented by zealots against Zerg only and it seems to be reasonably successful.  I try to make sure to hide my stargates from the overlord and it seems much of the time zerg simply only has a couple queens for anti air.  I'm but a mid level silver player, so it's possible it's not really viable since, you know, just against silver folks