git lfs throws "expected OID error"

This is probably the easiest solution. You don’t have to monkey with the git configuration files, and skipping the LFS files should be OK even if you build VTK-m as part of ParaView.