Is there some collection of router icons/png, that I can use without a license?
At least one picture. 
There is some Repro Lincensed with CC-BY-NC-SA 4.0.
I'm not sure this is the correct place to look for that. You probably should check sites that provide free graphics and check their terms