200 TOPS Peak Performance, AIBOX-9075 Brings Large AI Models to the Edge

0 Kommentare

As AI moves from the cloud to real-world devices, computing power, models, and development tools are all essential. Built on high-performance hardware, supported by a rich model ecosystem, and equipped with the complete AidLux toolchain, AIBOX-9075 lowers the barrier to development and helps teams deploy large AI models and vision AI applications directly at the edge.

Powerful Computing for Demanding AI Workloads

AIBOX-9075 is powered by the Qualcomm Dragonwing IQ9-series flagship industrial SoC, the IQ-9075. It integrates an eight-core, all-big-core Kryo Gen6 CPU and delivers up to 200 TOPS of peak INT8 AI performance for compute-intensive edge AI workloads and concurrent tasks. With CPU, GPU, and dual Hexagon NPU acceleration, it supports private, on-device deployment of large models and generative AI. Large-model inference performance reaches up to 12 TPS with a 13B-parameter model, meeting the needs of edge-based Q&A, knowledge bases, intelligent assistants, and similar applications.

Broad Model Support Across AI Applications

Through the AidLux Model Farm, developers can access a large collection of optimized models and sample code across the following categories:

The platform supports multiple precision formats, including FP16, INT8, W8A16, and W4A16, allowing developers to balance accuracy, speed, and resource usage. Model Farm also provides one-stop access to model search, performance references, downloads, and sample code, significantly reducing the effort required for model selection and adaptation.

Faster Deployment, Easier Development

1. Familiar Linux Development Environment

AIBOX-9075 runs Ubuntu 24.04 and supports both native compilation and ARM64 cross-compilation. Developers can use familiar tools such as GCC, CMake, Python, and OpenCV, making it suitable for rapid validation, on-site debugging, and production development.

2. Complete AidLux Software Toolchain

The out-of-the-box AI development and deployment toolchain integrates ten mainstream AI frameworks. A unified AidLite API automatically identifies models and matches them with the appropriate framework, enabling AI scenarios with only a few lines of code. A drag-and-drop Wizard tool supports no-code development, while Python alone can be used to build and deploy AI applications. Together, these capabilities lower the development barrier and shorten time to deployment.

AidLux Software Toolchain:

AIMO: Model conversion and optimization.

Model Farm / MMS: Model search, download, and management.

AidLite: Unified access to CPU, GPU, and NPU resources for common AI model inference.

AidGen: On-device inference for large language models and multimodal models.

AidGenSE: An OpenAI API-compatible HTTP service for easy integration with existing applications.

AidVoice: Speech recognition and speech synthesis.

AidStream: GStreamer-based processing for real-time video streams.

Intelligent Scene Analysis Platform Demo

The platform supports multiple types of video sources and uses vision-language models to understand on-screen content. Users can define preset conditions for different recognition scenarios in natural language. It is suitable for home security, production quality control, public safety, and other video-monitoring and recognition applications. The source article includes a real-world demonstration video.

Hardware and Industrial-Grade Adaptability

The system integrates GMSL2, CAN-FD, RS485, and optically isolated DI/DO interfaces. Its industrial wide-temperature design supports stable operation from -40°C to 85°C, enabling deployment in factories, vehicles, robots, outdoor sites, and other demanding environments.

GMSL2 is an automotive-grade serial-link technology designed for high-bandwidth video transmission. It supports up to eight cameras and long-distance transmission, allowing cameras to be deployed far from the central computing unit and simplifying installation in large equipment or vehicles. Low latency and strong noise immunity help maintain reliable data transmission in industrial environments and other locations with complex electromagnetic conditions.

Typical Application Scenarios

Industrial inspection: Product defect detection, OCR, PPE compliance detection, and equipment-status recognition

Intelligent monitoring: Analysis of people, vehicles, intrusions, abnormal behavior, and multiple video streams.

Robotics: Visual perception, scene understanding, voice interaction, and task control.

On-device large-model assistant: Local knowledge bases, equipment maintenance Q&A, and on-site work guidance.

Voice interaction: Voice control, speech transcription, and local voice assistants.

An Edge AI Platform Built for Real-World Deployment

AIBOX-9075 is more than a high-performance computing device; it is an integrated hardware and software platform built to bring edge AI into production. Its 200 TOPS peak performance supports complex models. Its broad model ecosystem spans vision, language, multimodal AI, and speech. The AidLux toolchain reduces the development barrier with a clear workflow and comprehensive tools from model selection through application integration.

For developers and enterprises, this means a faster end-to-end path from model validation and application development to on-site deployment, turning AI capabilities into production-ready products.

Reference and Contact

More informations,please contact:sales@t-firefly.com


Only 3.8 cm! Mini AI Vision SoM: ICORE-1126BQ38

Supports multi-card cascade inference, RK1828 Edge AI Local Deployment Solution

Hinterlasse einen Kommentar

Bitte beachte, dass Kommentare vor der Veröffentlichung freigegeben werden müssen.