Caustics and Flags of Chaos in Quantum Many-Body Systems