Connecting a hobby AGM 12 V battery to a charge controller (and the load terminal to the router) would be cheaper than the $100 system. But the same concept applies. You finally connect the wall wart output to the Input/Solar terminals.
Charge controller - ~ US$20 AGM battery- ~ US$20