Large external sensors data file for slam

How do we deal with a large external sensor data file (.csv) when running a slam (offline)?

For example, I had my lidar “on” for about an hour. I looped through all .pcap files for this capture to extract the lidar time frames, which is almost 200 million time frames. I used these times to synchronize with my GPS/IMU data to run the slam (offline) algorithm.

Hi Alex,

As of now, you would need to split your csv file to files that correspond (or at least include) the timesteps contained in ech of your pcap file.

If I understand correctly, this is already what you have done, right ?
Did you encouter issues with that approach ?

1 Like

Yes, I have my .pcap files for a single drone data collect split into 500MB each, with corresponding .csv files. It seems like this can be handled well using an intel core ultra 7 with 32 GB RAM.

The outputs look like the right “shape”, however, it looks like it is “projected” onto the wrong axis. I believe that is a separate question, so I will post a new question on the discussion board. Thanks!