So I'm working on a lego brick setup:

I'm struggling very much with trying to get glue constraints to work properly with my lego brick rbd setup. I've managed to create a bunch of connections that I want to use for a glue constraint setup:

The picture above is a series of prims I've generated, with green to red representing how strong the brick to brick connection is (more stud to hole connections means higher strength).
When I plug this into an rbdconstraintproperties and use an attribute to drive the strength of the glue, I can't seem to get it to work exactly how I want. Some parts of the glue constraint mesh is seperated, so when the sim begins I'd want those to fall and simulate seperately. But the result I get is the glue contraint network acting as a whole and even when I set some strengths to 0 it ignores it.
I've seen online and from others trying to help that you need to cluster and name pieces correctly, but i've had no luck with any of this. My end goal is to have the lego simulate like it work in real life, pieces that aren't connected to eachother will fall away, and pieces that are connected will use their strength value.
I've attached my constraint setup as well as a stash of the full mesh / proxy mesh. Any help, explinations or examples would be amazing!