Skip to content

10x-Engineers/infinite-isp_gpu

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 

Repository files navigation

infinite-isp_gpu

Proprietary commercial-grade CUDA-accelerated ISP purpose-built for NVIDIA® Jetson™ edge devices and discrete GPU platforms.

10xEngineers Logo

Infinite-ISP_GPU

GPU-Accelerated Image Signal Processing for NVIDIA Jetson & x86

High-Performance · Low-Latency · Real-Time Vision

License Platform CUDA GStreamer Latency RAW

🚀 Free Trial · 💬 Talk to Engineers · 📄 Docs · 🌐 Website


Overview

CUDA ISP is a fully GPU-accelerated Image Signal Processing (ISP) library designed for high-stakes real-time vision systems. It migrates resource-intensive tasks — demosaicing, white balance, color correction, noise reduction, and more — from the CPU to the GPU using optimized CUDA kernels.

Bypass hardware ISP limitations while preserving critical compute bandwidth for AI and robotics logic. Seamlessly integrates into existing pipelines via GStreamer.

RAW Sensor Data → GPU Memory → Parallel CUDA Kernels → Display / AI Pipeline

⚡ Key Metrics

Metric Value
End-to-end Latency 5 – 30 ms
RAW Input Bit Depth 8 – 16 bit
Processing Backend Fully GPU (CUDA)
Supported Platforms NVIDIA Jetson & x86-64
Pipeline Interface GStreamer compatible

��️ Architecture

┌─────────────────────────────────────────────────────────────────┐
│                        CUDA ISP Pipeline                         │
│                                                                   │
│  ┌──────────┐    ┌──────────┐    ┌─────────────────────────┐    │
│  │  Image   │    │   DMA    │    │     GPU Memory (VRAM)    │    │
│  │  Sensor  │───▶│ Transfer │───▶│   RAW Frame Buffer       │    │
│  └──────────┘    └──────────┘    └────────────┬────────────┘    │
│                                               │                   │
│                                               ▼                   │
│                          ┌────────────────────────────────────┐  │
│                          │     Parallel CUDA Kernel Execution  │  │
│                          │                                      │  │
│   ┌──────────────┐  ┌───────────────┐  ┌──────────────────┐   │  │
│   │  Sensor &    │  │  Color & Tone │  │  Quality &       │   │  │
│   │  Front-End   │  │  Processing   │  │  Analytics       │   │  │
│   │              │  │               │  │                  │   │  │
│   │ • BLC        │  │ • AWB / WB    │  │ • BNR / 2DNR    │   │  │
│   │ • Debayer    │  │ • CCM         │  │ • Sharpening     │   │  │
│   │ • DPC        │  │ • Gamma       │  │ • AE Stats       │   │  │
│   │ • DG         │  │ • CSC         │  │ • OSD            │   │  │
│   │ • Normalize  │  │ • RGBC        │  │                  │   │  │
│   └──────────────┘  └───────────────┘  └──────────────────┘   │  │
│                          └────────────────────────────────────┘  │
│                                               │                   │
│                                               ▼                   │
│                    ┌──────────────────────────────────────┐      │
│                    │   Zero-Copy EGLStream Buffers         │      │
│                    └────────────────┬─────────────────────┘      │
│                                     │                             │
│              ┌──────────────────────┴─────────────────────┐      │
│              │                                             │      │
│              ▼                                             ▼      │
│     ┌─────────────────┐                       ┌──────────────┐   │
│     │  Display Output │                       │  AI Pipeline │   │
│     └─────────────────┘                       └──────────────┘   │
└─────────────────────────────────────────────────────────────────┘

CUDA ISP runs entirely on the GPU and operates independently of fixed-function hardware ISPs. RAW frames are transferred directly to GPU memory via DMA and processed using massively parallel CUDA kernels.


�� ISP Module Coverage

CUDA ISP provides a modular, software-defined ISP pipeline covering all major image processing stages.

Sensor & Front-End

Module Description
NORMALIZE Input normalization for sensor data
BLC Black Level Correction
DPC Defective Pixel Correction
DG Digital Gain
Debayer / CFA Demosaicing / Color Filter Array interpolation

Color & Tone

Module Description
AWB / WB Auto White Balance / White Balance
CCM Color Correction Matrix
Gamma Gamma correction curve
CSC Color Space Conversion
RGBC RGB channel processing

Quality & Analytics

Module Description
BNR Bayer Noise Reduction
2DNR 2D Noise Reduction
Sharpen Edge sharpening
AE Stats Auto Exposure statistics
OSD On-Screen Display overlay

�� Built For

  • �� Custom imaging products
  • �� AI / ML dataset generation
  • �� Rapid ISP prototyping

�� Applications

🦾 Robotics & Industrial Vision

CUDA ISP conditions visual data to improve AI inference reliability in dynamic and uncontrolled environments. It reduces vision-related failures caused by motion, noise, and inconsistent lighting while sharing GPU resources with autonomy workloads.

Value delivered:

  • Improved navigation and inspection accuracy
  • Fewer false positives in AI pipelines
  • Efficient use of existing GPU compute
📹 Smart Surveillance & Video Analytics

CUDA ISP enhances video streams before analytics, improving detection accuracy without replacing deployed cameras. GPU acceleration enables real-time enhancement across large numbers of feeds.

Value delivered:

  • Better AI analytics from existing video infrastructure
  • Improved performance in low-light conditions
  • Cost-effective scaling across multiple streams
🏥 Medical Imaging & Endoscopy

CUDA ISP adds a programmable post-processing layer on NVIDIA GPUs that enhances live surgical video without altering the certified camera ISP. It improves visibility in low-light and narrow anatomical environments while maintaining surgical-grade latency and color consistency.

Value delivered:

  • Clearer visualization for clinicians
  • No redesign of existing camera hardware
  • Real-time enhancement with deterministic latency

Learn more →

🧠 AI Training & Vision Model Development

CUDA ISP provides controlled, repeatable image processing for dataset normalization and large-scale preprocessing. It removes dependency on fixed OEM ISP behavior, enabling consistent data quality across sensors and platforms.

Value delivered:

  • More consistent and reliable training data
  • Faster preprocessing at scale
  • Improved model convergence and accuracy
🚗 Autonomous Vehicles & ADAS

CUDA ISP processes high-bandwidth, multi-camera data directly on GPU, improving image quality before perception and planning. It stabilizes input across lighting extremes and camera variations without changing the sensor stack.

Value delivered:

  • More reliable perception in night and high-glare scenes
  • Scalable processing for multi-camera systems
  • Hardware-agnostic tuning across camera vendors

�� Why CUDA ISP?

Challenge CUDA ISP Solution
CPU-bound ISP bottlenecks All ISP stages run on GPU, freeing CPU for AI/robotics
No dedicated hardware ISP Full software ISP on any NVIDIA GPU
Fixed OEM ISP behavior Fully programmable, tunable pipeline
High integration effort Native GStreamer plugin support
Multi-camera scaling Parallel GPU processing across streams

�� Versions & Pricing

CUDA ISP Lite — USD 3,000

Entry-level ISP for basic evaluation and controlled lighting conditions.

Module Set
NORMALIZE
BLC, DG
CFA / Demosaicing
AWB / WB
CSC, RGBC

📦 GStreamer support coming soon


CUDA ISP Pro — USD 4,000

Full-featured ISP for production and advanced imaging systems.

Module Set
DPC, BLC, DG, WB, AWB
CFA, CCM, Gamma
BNR, 2DNR
AE Stats, Sharpen
CSC, RGBC, OSD

📦 GStreamer support coming soon


�� Evaluation

Request a time-limited evaluation to validate image quality, latency, and integration on your target platform before purchasing.

👉 Request Trial


�� Custom CUDA ISP

Need custom modules, sensor-specific tuning, or integration support? 10xEngineers provides:

  • HDR merge integration for challenging lighting
  • Spectral-calibrated auto white balance
  • Real-time contrast enhancement and tone mapping
  • AI-based pre-processing (denoising, feature extraction, enhancement)

👉 Talk to our imaging engineers


�� Contact

Email contact@10xengineers.ai
Website 10xengineers.ai
Location San Diego, CA, USA
LinkedIn 10x-engineers
YouTube @10xengineers

�� Related Products

Product Description
Infinite ISP FPGA-based ISP pipeline
HDR ISP High Dynamic Range ISP
LumaIQ AI-enhanced imaging
Polyphase Video Scaler IP Hardware video scaling IP

Copyright © 2024 10xEngineers · All Rights Reserved

About

Proprietary commercial-grade CUDA-accelerated ISP purpose-built for NVIDIA® Jetson™ edge devices and discrete GPU platforms.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors