P.S.: I have certainly my own preferences when it comes to Camera Tracking. Since I have used many different ones since way over a decade (not to brag here, but to give a little bit about my background with those), I’m used to have more access and control about the steps and results with other trackers. Ae isn’t giving me that kind of control.
However, I dove into the tracker as it is now AeCC to see how it would work with my tip about the Projection scale. Which seems to be the most comfortable approach. Scaling things up and down shows no difference in the reloaded scenes (c4D) in Ae. (This is not the Button with the Project scale, just the parameter!)
A short and rough (one minute) overview tries to showcase this. As usual, those one minute clips are not designed as a tutorial, just to provide more an idea about.
https://www.amazon.com/clouddrive/share/QNS5lahxbgHkjiBDR7tdj4KR2FBJfhPQalOz5WMyfbD?ref_=cd_ph_share_link_copy
My suggestion would be to explore other options for Architectural Visualizations. A good control inside the “Tracker” about the scale and lens distortion seems to me a must have.
Footage should be free of rolling shutter (especially not having post fixes of such, nor pre-stabilized) and should be the un-cropped version of the original footage.
To go more into detail, the tracker points that Ae places are based on the units of Ae, which are more in the realm of something like 72 pixel per inch, given the cameras calculation. Since Ae was a 2D app decades ago, this is kind of an inheritance. Anyway, Ae is designed for aesthetics and not for CAD work. In this way the tracker is great, but hard to combine with real world data. A skyscraper on a flat floor could be represented in a tracking result as the same as a cup on a table, and that would be OK for visuals. hence my suggestion to look into tracking options with easy workflow options to get a real world data calibration. Which one can do easily in C4D tracker. Have a look into some of the available training here.
My best wishes