Conntrackd problem with ipv6-icmp

I setup a (almost) working setup with two redundant routers using keepalived and conntrackd. The only thing that makes still problems ist ipv6-icmp: I can't reliably ping over IPv5 some hosts. Are there any experiences with such configurations?