I can heartily recommend these bags for wet & windy weather:
Drybags from Alpkit
The fact that they all come in orange is of course a bonus!
The only drawback, of course, with all of these types of bag (bin bags included) is the challenge of opening them without the weather getting in...