opendatalab/MinerU
View on GitHub ↗
Internal79
Unique within the repo — the other 21% repeats across its own files.
Public62
Unique across all public code — a further 17% is its own but appears in other public repos too.
Original and tidy — it rarely repeats itself, and little of it turns up in other public code. About as close to genuinely its own work as this metric can measure.
Worth consolidating — in the code
Real, actionable duplication in this repo's source, most concrete first.
Top duplication hotspots
| Similarity | Overlap | File A | File B | Cross-repo |
|---|---|---|---|---|
| 19% | 536 | opendatalab/MinerU/mineru/cli/fast_api.py |
opendatalab/MinerU/mineru/cli/router.py |
same repo |
| 46% | 522 | opendatalab/MinerU/mineru/backend/pipeline/pipeline_middle_json_mkcontent.py |
opendatalab/MinerU/mineru/backend/vlm/vlm_middle_json_mkcontent.py |
same repo |
| 67% | 386 | opendatalab/MinerU/mineru/backend/hybrid/hybrid_magic_model.py |
opendatalab/MinerU/mineru/backend/vlm/vlm_magic_model.py |
same repo |
| 27% | 328 | opendatalab/MinerU/mineru/backend/office/mkcontent/output_builders.py |
opendatalab/MinerU/mineru/backend/vlm/vlm_middle_json_mkcontent.py |
same repo |
| 12% | 321 | opendatalab/MinerU/mineru/cli/api_client.py |
opendatalab/MinerU/mineru/cli/router.py |
same repo |
| 20% | 278 | opendatalab/MinerU/mineru/backend/office/mkcontent/output_builders.py |
opendatalab/MinerU/mineru/backend/pipeline/pipeline_middle_json_mkcontent.py |
same repo |
| 7% | 275 | opendatalab/MinerU/mineru/cli/client.py |
opendatalab/MinerU/mineru/cli/gradio_app.py |
same repo |
| 10% | 209 | opendatalab/MinerU/mineru/backend/hybrid/hybrid_analyze.py |
opendatalab/MinerU/mineru/backend/pipeline/batch_analyze.py |
same repo |
| 12% | 200 | opendatalab/MinerU/mineru/backend/hybrid/hybrid_analyze.py |
opendatalab/MinerU/mineru/backend/vlm/vlm_analyze.py |
same repo |
| 39% | 194 | opendatalab/MinerU/mineru/backend/hybrid/hybrid_model_output_to_middle_json.py |
opendatalab/MinerU/mineru/backend/pipeline/model_json_to_middle_json.py |
same repo |
| 7% | 190 | opendatalab/MinerU/mineru/cli/client.py |
opendatalab/MinerU/mineru/cli/fast_api.py |
same repo |
| 5% | 187 | opendatalab/MinerU/mineru/cli/fast_api.py |
opendatalab/MinerU/mineru/cli/gradio_app.py |
same repo |
| 8% | 181 | opendatalab/MinerU/mineru/cli/api_client.py |
opendatalab/MinerU/mineru/cli/client.py |
same repo |
| 6% | 173 | opendatalab/MinerU/mineru/cli/client.py |
opendatalab/MinerU/mineru/cli/router.py |
same repo |
| 44% | 164 | opendatalab/MinerU/mineru/backend/hybrid/hybrid_model_output_to_middle_json.py |
opendatalab/MinerU/mineru/backend/vlm/model_output_to_middle_json.py |
same repo |
| 6% | 164 | opendatalab/MinerU/mineru/cli/api_client.py |
opendatalab/MinerU/mineru/cli/fast_api.py |
same repo |
| 10% | 157 | opendatalab/MinerU/demo/demo.py |
opendatalab/MinerU/mineru/cli/client.py |
same repo |
| 4% | 155 | opendatalab/MinerU/mineru/cli/gradio_app.py |
opendatalab/MinerU/mineru/cli/router.py |
same repo |
| 10% | 153 | opendatalab/MinerU/mineru/cli/api_request.py |
opendatalab/MinerU/mineru/cli/client.py |
same repo |
| 11% | 141 | opendatalab/MinerU/mineru/backend/hybrid/hybrid_magic_model.py |
opendatalab/MinerU/mineru/backend/office/office_magic_model.py |
same repo |
Docs & prose
Near-identical documentation — often translations (e.g. README.md ⇄ README_zh-CN.md) or mirrored guides. Usually intentional, not cleanup — listed separately so it doesn't inflate the code signal above.
Top duplication hotspots
| Similarity | Overlap | File A | File B | Cross-repo |
|---|---|---|---|---|
| 28% | 720 | opendatalab/MinerU/README.md |
opendatalab/MinerU/docs/en/quick_start/index.md |
same repo |
| 25% | 715 | opendatalab/MinerU/README.md |
opendatalab/MinerU/README_zh-CN.md |
same repo |
| 21% | 532 | opendatalab/MinerU/README.md |
opendatalab/MinerU/docs/en/index.md |
same repo |
| 29% | 460 | opendatalab/MinerU/docs/en/reference/output_files.md |
opendatalab/MinerU/docs/zh/reference/output_files.md |
same repo |
| 31% | 361 | opendatalab/MinerU/README_zh-CN.md |
opendatalab/MinerU/docs/zh/quick_start/index.md |
same repo |
| 31% | 353 | opendatalab/MinerU/README_zh-CN.md |
opendatalab/MinerU/docs/zh/index.md |
same repo |
| 52% | 333 | opendatalab/MinerU/docs/en/index.md |
opendatalab/MinerU/docs/zh/index.md |
same repo |
| 24% | 328 | opendatalab/MinerU/README_zh-CN.md |
opendatalab/MinerU/docs/en/index.md |
same repo |
| 13% | 324 | opendatalab/MinerU/README.md |
opendatalab/MinerU/docs/zh/index.md |
same repo |
| 5% | 273 | opendatalab/MinerU/README.md |
opendatalab/MinerU/docs/en/reference/changelog.md |
same repo |
| 27% | 250 | opendatalab/MinerU/docs/en/quick_start/index.md |
opendatalab/MinerU/docs/zh/quick_start/index.md |
same repo |
| 14% | 242 | opendatalab/MinerU/README_zh-CN.md |
opendatalab/MinerU/docs/en/quick_start/index.md |
same repo |
| 9% | 240 | opendatalab/MinerU/README.md |
opendatalab/MinerU/docs/zh/quick_start/index.md |
same repo |
| 17% | 205 | opendatalab/MinerU/docs/en/index.md |
opendatalab/MinerU/docs/en/quick_start/index.md |
same repo |
| 32% | 181 | opendatalab/MinerU/docs/zh/index.md |
opendatalab/MinerU/docs/zh/quick_start/index.md |
same repo |
| 18% | 181 | opendatalab/MinerU/docs/en/quick_start/index.md |
opendatalab/MinerU/docs/zh/index.md |
same repo |
| 22% | 179 | opendatalab/MinerU/docs/en/index.md |
opendatalab/MinerU/docs/zh/quick_start/index.md |
same repo |
| 4% | 126 | opendatalab/MinerU/docs/en/reference/changelog.md |
opendatalab/MinerU/docs/zh/reference/changelog.md |
same repo |
| 58% | 107 | opendatalab/MinerU/docs/zh/usage/acceleration_cards/METAX.md |
opendatalab/MinerU/docs/zh/usage/acceleration_cards/THead.md |
same repo |
| 3% | 107 | opendatalab/MinerU/docs/en/quick_start/index.md |
opendatalab/MinerU/docs/en/reference/changelog.md |
same repo |
Largest files
Largest files
| LOC | File | Status |
|---|---|---|
| 2080 | opendatalab/MinerU/mineru/cli/gradio_app.py | indexed |
| 1673 | opendatalab/MinerU/mineru/cli/router.py | indexed |
| 1474 | opendatalab/MinerU/mineru/cli/fast_api.py | indexed |
| 1310 | opendatalab/MinerU/mineru/backend/hybrid/hybrid_analyze.py | indexed |
| 1224 | opendatalab/MinerU/mineru/cli/client.py | indexed |
| 1065 | opendatalab/MinerU/mineru/cli/api_client.py | indexed |
| 1025 | opendatalab/MinerU/mineru/backend/pipeline/pipeline_middle_json_mkcontent.py | indexed |
| 989 | opendatalab/MinerU/mineru/backend/utils/office_chart.py | indexed |
| 978 | opendatalab/MinerU/mineru/backend/pipeline/batch_analyze.py | indexed |
| 965 | opendatalab/MinerU/mineru/backend/office/mkcontent/inline_renderer.py | indexed |