AWS Organizations is the standard approach to managing a hierarchy of accounts. However, it does not allow billing to be consolidated at arbitrary points in the organization; it's a tree, not a graph.
Given that, here is what I would recommend:
Adopt an "infrastructure as code" tool to manage your users and permissions.
This is the most important thing ...