AI article

The official RKLLM vision demo doesn't run on the transformers it targets — a five-version bisection

Community description: I'm converting Qwen2-VL-2B-Instruct to run on a Rockchip board with Rockchip's official rknn-llm...

Dev.to | Nov 8, 2026 | Anguo

Automated excerpt

Step one is exporting the vision tower to ONNX with the repo's own multimodal demo script. Not on my code — on the repo's own script, with the transformers generation the repo's newer scripts are written for. AttributeError — the export script reads model.visual; in 5.x the attribute moved to model.model.visual works — source check confirms it has both self.visual and the rotary_pos_emb fallback So the export script is written against a pre-4.54 contract, while sitting in the same repo as a quantization script that already uses the 5.x module layout (model.model.language_model).

Selected automatically from source text; not independently written or fact-checked. Read the original for full context.

Read the original article

Read next

AI briefing: recent picks

More stories to explore