OpenWrt Forum Archive

Topic: adblock package, release 2.x

The content of this topic has been archived between 22 Mar 2018 and 4 May 2018. Unfortunately there are posts – most likely complete pages – missing.

positronik wrote:
root@OpenWrt:~# cat /etc/adblock/adblock.whitelist 
mailchimp.com
root@OpenWrt:/storage# grep -e mailchimp.com adb_list.shalla
address=/mailchimp.com/192.0.2.1
address=/mailchimp.com/::ffff:c000:0201

I grepped the stored shalla's list because I had to disable it to access that domain...

shallalist.de is currently down, so adblock takes your backup (with activated mailchimp.com). The whitelist function is not active during backup/restore ... only fresh downloads will be parsed.

Options: Delete these two lines in your backup, delete shalla archive at all or deactive shallaist source and wait until shallist is back again.

(Last edited by dibdot on 5 Jun 2016, 12:17)

dibdot wrote:

shallalist.de is currently down, so adblock takes your backup (with activated mailchimp.com). The whitelist function is not active during backup/restore ... only fresh downloads will be parsed.

Options: Delete these two lines in your backup, delete shalla archive at all or deactive shallaist source and wait until shallist is back again.

Good to know that whitelist check is not done on archived lists! Thank you!
And BTW thanks for the program, is awesome.

positronik wrote:
dibdot wrote:

shallalist.de is currently down, so adblock takes your backup (with activated mailchimp.com). The whitelist function is not active during backup/restore ... only fresh downloads will be parsed.

Options: Delete these two lines in your backup, delete shalla archive at all or deactive shallaist source and wait until shallist is back again.

Good to know that whitelist check is not done on archived lists! Thank you!
And BTW thanks for the program, is awesome.

Thanks, I've already changed that behaviour in the forthcoming 1.2.0 release, but it's not ready for prime time yet.

WildByDesign wrote:

@dibdot and @slh,  Thank you both for your responses.

Dirk, especially thank you for explaining how the whitelists/blacklists are being processed in a way that was easy for me to understand.  Your suggestion of being more specific with the subdomains as well has fixed my slow downs and YouTube videos are loading immediately now which is fantastic.  I appreciate your time and your hard work.  And I will definitely keep my fingers crossed for the future possibility of having more power with the whitelists/blacklists.

I will send a quick email shortly as well with a copy of the network traffic details from Chromium's developer tools. Essentially though, this was affecting any and all YouTube videos for me and all of the advertisement/tracker servers were being delayed and giving a "failed" response (each with a delay of approx. 4 seconds), I assume to be a time out of some sort.  After following your suggestion to be specific with subdomains, all videos are loading immediately and instead of failed responses, the advertisement/tracker servers are providing error "500" status and only a typical delay of approx. 1-2ms.  So all is well now.  But I will send the network capture screenshot to your email shortly anyway for curiosity sake.  Thank you again for your help.

Can you share what domains you used because I am also having the long load times on all Youtube Videos.

havent bacread much on the thread yet so im asking this.

Is this can work with mwan3 simultaneously? The adblock that I used I think 6 months ago if my memory serves right, breaks mwan3 and needed to be restarted every time the adblock updates something (I guess the iptables that it ommit to the firewall causes the mwan3 to break).

Irken Skoodge wrote:

Can you share what domains you used because I am also having the long load times on all Youtube Videos.

Absolutely, I'm happy to share what worked for my YouTube issues.

The following is the contents of my adblock.whitelist file.  You will need to restart the adblock service to make these changes take affect.

googlesyndication.com
googleadservices.com
google-analytics.com
doubleclick.net
turner.com
cdn.turner.com
i2.cdn.turner.com

The three bottom lines are unrelated to the YouTube issue.  That was to resolve issues with CNN.com but I still have not been able to fix that yet.  But those first four lines resolved my YouTube issues and have not had any issues since.  I hope that helps.

remlei wrote:

havent bacread much on the thread yet so im asking this.

Is this can work with mwan3 simultaneously? The adblock that I used I think 6 months ago if my memory serves right, breaks mwan3 and needed to be restarted every time the adblock updates something (I guess the iptables that it ommit to the firewall causes the mwan3 to break).

Please wait for adblock 1.2.0, it will change the firewall handling.

WildByDesign wrote:

The following is the contents of my adblock.whitelist file.  You will need to restart the adblock service to make these changes take affect.

googlesyndication.com
googleadservices.com
google-analytics.com
doubleclick.net

Thanks for sharing, but I think it doesn't make sense to whitelist such "evil" sites ... smile
I'll contact you by mail to find the root cause for your timeouts ...

(Last edited by dibdot on 6 Jun 2016, 12:18)

firewall statistics (IPv4/IPv6): 24.25%/0% of all packets in prerouting chain are ad related & blocked

Statistics are an impressive thing.  It is unnerving to think that nearly a quarter of our Internet traffic these days is related to advertisement and tracking packets.

Keep up the great job, Dirk.  You are doing wonderful things to help users of the OpenWrt community to filter their networks of unneeded traffic and keeping their browsing experience clean and efficient.

Hi, Thanks for a wonderful adblock implementation.

I am having a similar problem with YouTube delays - it seems about 20 seconds that the ad normally takes. Chrome F12 tools shows doubleclick.net and googlesyndication.com failing - which is good. I'm not prepared to enable those sites. The easiest way to test is in incognito mode of Chrome. The 20 second delay appears the first few videos.

I'm using the default adaway, disconnect and yoyo lists with no other modifications.

My question is: Is there a way to block the ads but not have the delay?

Thanks heaps
Graham

On a different issue, there are unpleasant sites that briefly redirect to ad.doubleclick.net before forwarding on to another site.

For instance, when clicking on a picture of a house on the real estate site nestoria.com.au/melbourne/real-estate-property/sale, you are redirected to ad.doubleclick.net then to domain.com.au a valid Australian real estate site.

This is a valid process for the site, but directing through a blocked URL fails.

This does not pass the wife factor!  smile

Though I can't see an immediate solution - again not willing to open ad.doubleclick.net.

Your thoughts?
Graham

never2tyred wrote:

My question is: Is there a way to block the ads but not have the delay?

The YouTube issue was acknowledged and should be resolved in the latest adblock 1.2.0 release. You can grab that release now which is working very well or wait a few hours until the 1.2.1 point release propagates to all of the device directories within the servers.  Regardless of device type, the .ipk package works even if the device directory does not match your specific chipset.

Download:  adblock_1.2.0-1_all.ipk (or adblock_1.2.1-1_all.ipk depending on when you check)
From:  https://downloads.openwrt.org/snapshots … /packages/

Download:  luci-app-adblock_git-16.164.65694-cd50f27-1_all.ipk (or similar name depending on revision)
From:  https://downloads.openwrt.org/snapshots … ages/luci/

If you still experience the YouTube delays with the 1.2.x releases, reply back to let the developers know.

never2tyred wrote:

My question is: Is there a way to block the ads but not have the delay?

Thanks heaps
Graham

This has been fixed in adblock 1.2

never2tyred wrote:

On a different issue, there are unpleasant sites that briefly redirect to ad.doubleclick.net before forwarding on to another site.

For instance, when clicking on a picture of a house on the real estate site nestoria.com.au/melbourne/real-estate-property/sale, you are redirected to ad.doubleclick.net then to domain.com.au a valid Australian real estate site.

This is a valid process for the site, but directing through a blocked URL fails.

This does not pass the wife factor!  smile

Though I can't see an immediate solution - again not willing to open ad.doubleclick.net.

Your thoughts?
Graham

1. do not use this ad bloated real estate metacrawler
2. new wife (just kidding) wink
3. use /etc/init.d/adblock toggle to quickly disable/enable adblock ... but this probably won't pass the wife factor, too.
4. sorry, no further idea ...

(Last edited by dibdot on 15 Jun 2016, 19:38)

Thanks a lot for adb_restricted smile

dibdot wrote:
never2tyred wrote:

My question is: Is there a way to block the ads but not have the delay?

Thanks heaps
Graham

This has been fixed in adblock 1.2

Thanks dibdot once again for a great adblock system! Graham

Hello.

I am a noob but I can still easily have this wonderful package worked like a charm. Thanks dibdot.

I just came across the browser history finding that my son (preteen) surfed some adult sites. I googled and tried to find a solution to block those sites to no avail. Can someone please show me how to add adult source to the blacklist and auto update thereafter like ads site.

My router is Wrt1900ACS with DD, so I believe there is enough space

Any help would be greatly appreciated.

(Last edited by huangjqiu on 18 Jun 2016, 16:15)

huangjqiu wrote:

I just came across the browser history finding that my son (preteen) surfed some adult sites. I googled and tried to find a solution to block those sites to no avail. Can someone please show me how to add adult source to the blacklist and auto update thereafter like ads site.

please check the shallalist categories ... probably 'porn' is that what are you looking for. Simply add the following line to adblock config and restart adblock:

config source 'shalla'
        [...]
        list adb_src_cat 'porn'

But be warned, this category is quite big > 700K domains ... here are the current runtime logs on an apu2:

dblock[13200] info : all adblock related services stopped
adblock[13375] info : domain adblock processing started (1.2.5, r706, 18.06.2016 17:48:52)
[...]
adblock[13375] info : => processing source 'shalla'
adblock[13375] info :    source download finished (770497 entries)
[...]
adblock[13375] info : block lists with overall 836193 domains loaded
adblock[13375] info : firewall statistics (IPv4/IPv6): 30.32%/0% of all packets in prerouting chain are ad related & blocked
adblock[13375] info : domain adblock processing finished successfully (1.2.5, r706, 18.06.2016 17:58:18)

blacklist  does not work for me.


For example, I tried to block "google.ru". I added the entry "google.ru" to /etc/adblock/adblock.blacklist

vi /etc/adblock/adblock.blacklist

Now I have one entry in adblock.blacklist
google.ru

I restart "adblock":

 /etc/init.d/adblock start
/etc/init.d/adblock restart

But I can open google.ru.

How can I block this site with adblock?

vjg wrote:

blacklist  does not work for me.

logs please ... just a rough guess: did you enable the blacklist as a source in the config, maybe you've forgot that!?

Thank you for your answer. Yes, I forgot about this.

5 minutes ago I added blacklist in /etc/config/adblock and now this thing works.

dibdot wrote:
huangjqiu wrote:

I just came across the browser history finding that my son (preteen) surfed some adult sites. I googled and tried to find a solution to block those sites to no avail. Can someone please show me how to add adult source to the blacklist and auto update thereafter like ads site.

please check the shallalist categories ... probably 'porn' is that what are you looking for. Simply add the following line to adblock config and restart adblock:

config source 'shalla'
        [...]
        list adb_src_cat 'porn'

But be warned, this category is quite big > 700K domains ... here are the current runtime logs on an apu2:

dblock[13200] info : all adblock related services stopped
adblock[13375] info : domain adblock processing started (1.2.5, r706, 18.06.2016 17:48:52)
[...]
adblock[13375] info : => processing source 'shalla'
adblock[13375] info :    source download finished (770497 entries)
[...]
adblock[13375] info : block lists with overall 836193 domains loaded
adblock[13375] info : firewall statistics (IPv4/IPv6): 30.32%/0% of all packets in prerouting chain are ad related & blocked
adblock[13375] info : domain adblock processing finished successfully (1.2.5, r706, 18.06.2016 17:58:18)

It works. Thank you very much for your help.

@dibdot,  I just wanted to send a brief comment to mention that these 1.2.x releases have proven to be rock solid since the split in uhttpd between http/https.  You've done a fantastic job, Dirk.

firewall statistics (IPv4/IPv6): 24.25%/0% of all packets in prerouting chain are ad related & blocked

Hey guys - is there some easy way to see these statistics without restarting the adblock service? Thanks!

dape wrote:

Hey guys - is there some easy way to see these statistics without restarting the adblock service? Thanks!

You mean something like this?

Syntax: /etc/init.d/adblock [command]

Available commands:
    start    Start the service
    stop     Stop the service
    restart  Restart the service
    reload   Reload configuration files (or restart if that fails)
    enable   Enable service autostart
    disable  Disable service autostart
    toggle   Toggle adblocking 'on' or 'off'
    stats    Update adblock statistics
    cfgup    Update the adblock configuration file

root@adb2go:/etc/init.d$ /etc/init.d/adblock stats
adblock[6597] info : firewall statistics (IPv4/IPv6): 20.14%/0% of all packets in prerouting chain are ad related & blocked

Wait for 1.2.7 ... smile