Bioaccumulation is certainly a factor to be concerned about, but you can't skip over the part where you definitively demonstrate harm.

Lots of things bioaccumulate, but cause no problems at all.