It depends on the plastic and the acid involved.

Most plastics are unreactive with most acids. Sometimes, like with Hydrofluoric acid, it must be stored in plastic, because it can dissolve glass.