In Ah Ko

Hi genius people on the internet!

I'm working on a flower bloom sim with some vellum, but when I vellum solve it the edges go very spiky.
nothing much inside the vellum solver, I only got popwind.
Is there a general way to solve this kind of glitching?
I tried increasing my substeps to 4, and constraint iterations to 150 but didn't change much.

I can't post my file so I attached bunch of screenshots ;(

Thanks in advance!