Skip to content

feat(models): add cohere micro vision - #3518

Merged
HuiyingLi merged 7 commits into
NVIDIA-NeMo:mainfrom
zeryx:zeryx/feat/cohere-micro-vision
Aug 12, 2026
Merged

HuiyingLi merged 7 commits into
NVIDIA-NeMo:mainfrom
zeryx:zeryx/feat/cohere-micro-vision

Conversation

@zeryx

@zeryx zeryx commented Aug 12, 2026 •

Copy link
Copy Markdown
Contributor

What does this PR do ?

This PR add's Cohere's latest Micro Vision VLM model to automodel, with multiple SFT/LoRA Recipes

Changelog

  • Add examples/vlm_finetune/cohere_micro_vision/north_micro_vision_rdr.yaml LoRA SFT on the RDR dataset, LoRA injection, FSDP2 and checkpointing.
  • Add examples/vlm_finetune/cohere_micro_vision/north_micro_vision_shopify_full.yaml full-epoch LoRA SFT on Shopify/product-catalogue at DP2 with FSDP2.
  • Add examples/vlm_finetune/cohere_micro_vision/north_micro_vision_shopify_lora.yaml 2,000-sample bounded variant for pipeline smoke tests.
  • Add examples/vlm_finetune/cohere_micro_vision/north_micro_vision_shopify_resume.yaml restores from a checkpoint written by the bounded variant to exercise the resume path.
  • Add docs/model-coverage/vlm/coherelabs/north-micro-vision.mdx architecture notes, recipe table, run instructions.
  • Register the page under VLM model coverage in docs/fern/versions/nightly.yml.
  • Add CohereLabs/North-Micro-Vision-instruct-preview to the supported-models table in README.md.
  • Exempt cohere_micro_vision from release-scope CI auto-discovery in tests/ci_tests/configs/vlm_finetune/override_recipes.yml, since the model's remote code needs transformers 5.15 while release CI installs the pinned 5.8.1; remove once ci: Update transformers to latest version 5.15.0 #3516 merges.

Pre checks:

  • Make sure you read and followed Contributor guidelines
  • Did you write any new necessary tests?
  • FYI Cohere Micro Vision requires a transformers pin we haven't upgraded to yet, which will fail the existing nightly_recipes CI.
  • Did you add or update any necessary documentation?

If you haven't finished some of the above items you can still open "Draft" PR.

@copy-pr-bot

copy-pr-bot Bot commented Aug 12, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@HuiyingLi HuiyingLi changed the title Zeryx/feat/cohere micro vision feat(models): add cohere micro vision Aug 12, 2026
@zeryx
zeryx force-pushed the zeryx/feat/cohere-micro-vision branch from beaa80f to b17716d Compare August 12, 2026 16:17
@zeryx
zeryx requested a review from a team as a code owner August 12, 2026 16:17
Signed-off-by: zeryx <1892175+zeryx@users.noreply.github.com>
@zeryx
zeryx force-pushed the zeryx/feat/cohere-micro-vision branch from b17716d to 948fc04 Compare August 12, 2026 16:18
…formers 5.15

Signed-off-by: zeryx <1892175+zeryx@users.noreply.github.com>
@zeryx
zeryx force-pushed the zeryx/feat/cohere-micro-vision branch from 948fc04 to 745e50f Compare August 12, 2026 16:20
Signed-off-by: HuiyingLi <willwin.lee@gmail.com>
Signed-off-by: HuiyingLi <willwin.lee@gmail.com>
Signed-off-by: HuiyingLi <willwin.lee@gmail.com>
@HuiyingLi HuiyingLi added the docs-only With great power comes great responsibility. label Aug 12, 2026
@HuiyingLi

Copy link
Copy Markdown
Contributor

/ok to test dde6b39

@github-actions

github-actions Bot commented Aug 12, 2026 •

Copy link
Copy Markdown
Contributor

HuiyingLi and others added 2 commits August 12, 2026 09:38
Signed-off-by: HuiyingLi <willwin.lee@gmail.com>
Signed-off-by: zeryx <1892175+zeryx@users.noreply.github.com>
@HuiyingLi

Copy link
Copy Markdown
Contributor

/ok to test ff6795b

@HuiyingLi
HuiyingLi merged commit 8e53272 into NVIDIA-NeMo:main Aug 12, 2026
38 checks passed
@jgerh

jgerh commented Aug 12, 2026

Copy link
Copy Markdown
Contributor

Tech Pubs was assigned as a code reviewer on this PR, but it was merged before we had the opportunity to review the new markdown file: docs/model-coverage/vlm/coherelabs/north-micro-vision.mdx. Per our policy, all customer-facing documentation must be reviewed by Tech Pubs before release. Could we please create a fast-follow PR to address any necessary documentation updates, or align on a process to ensure Tech Pubs sign-off happens prior to merging in the future?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

community-request docs-only With great power comes great responsibility.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants