Let’s deploy LLMs everywhere! What could possibly go wrong?