PoisonedRAG

An attack that inserts a small number of carefully crafted documents into a knowledge base used for Retrieval-Augmented Generation, so that when a target query is asked, the poisoned documents are retrieved and steer the model toward an attacker-chosen answer.