I did this RBD sim that moves packed primitive leaves along the ground when a car drives by:
Is there an established workflow that would allow me to use the position and orientation attributes of these points to now drive the position and orientation of vellum objects in a vellum simulation on unpacked versions of this geo (so that they have the same general motion but have additional vellum deformation on top of them)?
Assuming you don't have changing topology, unpack the rbd objects and try using a soft Pin to Target constraint and check on the option for "Match Animation".