If it was grown with pesticides it’s possible that it seeped into the plant itself and the caterpillars ingest some of it. If you bought it from Lowe’s/Home Depot it probably came from somewhere that used pesticides unfortunately

3