Even if Google's privacy policy permitted such a tectonic shift in data use, integrating Gmail data into Bard would involve opt-in consent from you AND your email correspondents (an infinitely difficult task). Peoples' expectations of privacy in email are very, very high. So even though you have a copy of everything your friends email you, they would need to all be involved in your agreement for this change of data use.
