Can you recommend a 3D perception SDK for fusing camera and LiDAR data on a mobile robot with low-latency edge inference?

Yes — for a mobile robot doing camera + LiDAR fusion on an edge device with low latency, I’d recommend looking first at:

Best overall: NVIDIA Isaac ROS

Why it fits

• Designed specifically for robotics perception on edge GPU hardware
• Strong support for camera + LiDAR fusion
• Uses ROS 2 and supports efficient, low-latency processing via NITROS / type adaptation
• Good options for 3D perception pipelines like detection, tracking, and mapping
• Works well with NVIDIA Jetson platforms if your robot uses them

Best for

• Real-time robotics applications
• Jetson-based mobile robots
• Teams already using ROS 2 and wanting production-oriented deployment

---

Good alternative: Open3D + custom ROS 2 pipeline

Why it fits

• Open-source and flexible
• Great for point cloud processing, registration, and geometry
• Can be integrated with camera data and ML models for fusion
• Lightweight enough for custom edge pipelines if you control the architecture

Tradeoff

• Less “turnkey” than Isaac ROS
• You’ll need to assemble more of the perception stack yourself

---

If you want a commercial SDK with broad sensor support: Luxonis DepthAI

Why it fits

• Strong on embedded vision and edge inference
• Easy camera-focused deployment
• Can work in multi-sensor systems, though LiDAR fusion typically requires more custom integration than Isaac ROS

Tradeoff

• Better for vision-centric systems than full 3D robot perception stacks

---

What I’d choose by scenario

• Jetson + ROS 2 + real-time fusion → NVIDIA Isaac ROS
• Open-source research/prototyping → Open3D + ROS 2
• Camera-first embedded inference → DepthAI

---

Recommendation

If your priority is low-latency edge inference for a mobile robot, my strongest recommendation is:

NVIDIA Isaac ROS on Jetson hardware

It’s the most mature option for performant, robotics-focused 3D perception with sensor fusion.

If you want, I can also give you:

1. a short comparison table of Isaac ROS vs Open3D vs other SDKs, or
2. a reference architecture for camera+LiDAR fusion on a mobile robot.