Yeah, turns out dragonglass kills Others/White Walkers instantly. Little effect on the wights though. But as to who stashed the weapons, you don't even get a hint of an answer to that until book 5.
Coldhands probably did it. Or Bloodraven/the one-eyed crow. Or Coldhands, who was controlled by Bloodraven the whole time.