I now figured it out 
With the depth scale from property.rvproj you can use the 3x4 matrix in Q.bin to transform the depth maps into 3D. And then using the 4x4 matrix from the frame’s *.inf file will perfectly align multiple keyframes: revoscan_5_parse_cache.py · GitHub
2 Likes