Skip to content

Backport #6893 to releases/28.0: E-Document MLLM extraction with ADI fallback#7101

Open
Groenbech96 wants to merge 1 commit intoreleases/28.0from
backport/releases/28.0/6893
Open

Backport #6893 to releases/28.0: E-Document MLLM extraction with ADI fallback#7101
Groenbech96 wants to merge 1 commit intoreleases/28.0from
backport/releases/28.0/6893

Conversation

@Groenbech96
Copy link
Contributor

@Groenbech96 Groenbech96 commented Mar 11, 2026

Summary

Cherry-pick of #6893 to releases/28.0.

AB#618414

## Summary
- Add MLLM (Multimodal LLM) extraction as a new structured data handler
for e-document PDF processing, with automatic fallback to ADI (Azure
Document Intelligence) when MLLM fails
- Introduce experiment gate in `EDocPDFFileFormat` with
`OnOverrideStructureDataImpl` integration event for cross-app override
- Add dedicated `"E-Document MLLM Analysis"` Copilot Capability enum
value
- Prefill `accounting_customer_party` from Company Information to help
the LLM distinguish buyer from vendor
- Add system prompt instructions for customer vs vendor identification



[AB#618414](https://dynamicssmb2.visualstudio.com/1fcb79e7-ab07-432a-a3c6-6cf5a88ba4a5/_workitems/edit/618414)

---------

Co-authored-by: Magnus Hartvig Grønbech <magnushar@microsoft.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
@Groenbech96 Groenbech96 requested review from a team as code owners March 11, 2026 16:55
@github-actions github-actions bot added the AL: Apps (W1) Add-on apps for W1 label Mar 11, 2026
@github-actions github-actions bot added this to the Version 28.0 milestone Mar 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

AL: Apps (W1) Add-on apps for W1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant