Setup Proxy Server setting within router

Installing and Using OpenWrt Network and Wireless Configuration
3

Google for WPAD standard and DHCP's option 252, perhaps that will fulfill your needs.