CSB1-N10R3588 Computing Power Server 60T Large Model Privatization Deployment 1U BMC Ruixin Micro

1U rack-mounted computing power server

ARM architecture

10 distributed computing nodes (up to 80 ARM cores) + 1 control node

Octa-core 64-bit processor RK3588, main frequency up to 2.4GHz

Octa-core 64-bit processor RK3588, main frequency up to 2.4GHz, the highest computing power is 6TOPS

60TOPS (INT8)

6 high-speed cooling fans

• IEC 297 Universal Cabinet Installation: 19 inches wide and 800 mm deep and above
• Retractable slideway installation: The distance between the front and rear holes of the cabinet is 543.5mm - 848.5mm

The BMC management system is integrated with the web-based management interface, supporting Redfish, VNC, NTP, monitoring advanced and virtual media, and the BMC management system can be redeveloped

Support the privatization deployment of ultra-large-scale parametric models under the Transformer architecture, such as Gemma-2B, ChatGLM3-6B, Qwen-1.8B, Phi-3-3.8B and other large language models

It supports traditional network architectures such as CNN, RNN, and LSTM, and supports the import and export of RKNN models; Support a variety of deep learning frameworks, including TensorFlow, TensorFlow Lite, PyTorch, Caffe, ONNX and Darknet. It also supports the development of custom operators

1 × Console (RJ45, BMC debug serial port, baud rate 115200)

RK3588

Octa-core 2.4GHz

256GB eMMC × 10 (Number of compute nodes)(Optional: 16GB/32GB/64GB/128GB/256GB)

3.5-inch/2.5-inch SATA3.0/SSD hard drive slot × 1 (BMC can directly operate the hard drive, and computing child nodes can indirectly access the hard drive through the network sharing method provided by BMC)

550W AC power supply (Input: 90V AC~264V AC, 47 Hz~63 Hz, 8A) (Hot swappable not supported)

1 × VGA (maximum resolution 1080P, BMC management display)

420.0mm(L) × 421.3mm(W) × 44.4mm(H)

Server net weight: 8.1kg, total weight with packaging: 10.3kg

• Operating Temperature: 0ºC ~ 45ºC
• Storage Temperature: -40ºC ~ 60ºC
• Operating Humidity: 5% ~ 90%RH(non-condensing)

2 × 10G Ethernet (SFP+), 2 × Gigabit Ethernet (RJ45), 1 × Gigabit Ethernet (RJ45, MGNT is used as BMC management network)

2 × USB3.0 (The lower USB is USB3.0 OTG, and the BMC can be upgraded OTG by using a USB flash drive)

1 × Reset, 1 × UID, 1 × Power button

1 × RS232 (DB9, baud rate 115200), 1 × RS485 (DB9, baud rate 115200)