AI article
The official RKLLM vision demo doesn't run on the transformers it targets — a five-version bisection
Community description: I'm converting Qwen2-VL-2B-Instruct to run on a Rockchip board with Rockchip's official rknn-llm...
Dev.to | Nov 8, 2026 | Anguo
Automated excerpt
Step one is exporting the vision tower to ONNX with the repo's own multimodal demo script. Not on my code — on the repo's own script, with the transformers generation the repo's newer scripts are written for. AttributeError — the export script reads model.visual; in 5.x the attribute moved to model.model.visual works — source check confirms it has both self.visual and the rotary_pos_emb fallback So the export script is written against a pre-4.54 contract, while sitting in the same repo as a quantization script that already uses the 5.x module layout (model.model.language_model).
Selected automatically from source text; not independently written or fact-checked. Read the original for full context.