[Code Refactor] Large Updates Since Aug #292
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
commit 98fee55b4487e2be256d34c0ae6521714cfefb94 Author: Li Bo <[email protected]> Date: Wed Sep 20 18:05:15 2023 +0000 update benchmark script commit 9090ffd7eb146a17a2d1de6f55d73b4198c32a78 Author: Li Bo <[email protected]> Date: Wed Sep 20 17:39:06 2023 +0000 reuse the traditional way to log inference scripts commit 28bbf8b08a03f9d95eee0982de4464819a761b72 Author: Li Bo <[email protected]> Date: Wed Sep 20 17:22:39 2023 +0000 update dual output commit f231750bd7ae08857e331ecdede850b12940f9ae Author: Li Bo <[email protected]> Date: Wed Sep 20 16:56:17 2023 +0000 update commit 636d3946756af469b341fd8d5ac4f7281fcaa6c4 Author: Li Bo <[email protected]> Date: Wed Sep 20 16:52:37 2023 +0000 update commit e8570413d9ac4d54b936d3490293e0bfe7ea8e89 Author: Li Bo <[email protected]> Date: Wed Sep 20 16:21:56 2023 +0000 update inference formatting commit d4effe0a0210d99a4653b2c56433962c6341fa3d Author: Li Bo <[email protected]> Date: Wed Sep 20 01:19:01 2023 +0000 update commit bf20249a716b212dea68dc047aff198b6022419a Author: Li Bo <[email protected]> Date: Wed Sep 20 01:18:59 2023 +0000 update commit f75c4285588ce96ee227d2e3c9d9b64a5ac6e668 Author: Li Bo <[email protected]> Date: Tue Sep 19 17:33:49 2023 +0000 update commit e530f75fceb9dc259324fd7a76d5fa38dec606b9 Merge: 43f7506 cf31407 Author: Li Bo <[email protected]> Date: Tue Sep 19 12:54:52 2023 +0000 Merge branch 'dev/data-mixture' of https://github.com/Luodian/Otter-2 into dev/data-mixture commit 43f75064cddea24baa12091de2185363e8aaf155 Author: Li Bo <[email protected]> Date: Tue Sep 19 12:54:50 2023 +0000 update key to mimicit data class commit cf31407c160ff9ab8cbd67d220c304756c1a8ab8 Author: Bo Li <[email protected]> Date: Tue Sep 19 20:34:22 2023 +0800 ungit something commit 4bccdf62dea911d01f442beb63e1c46f2ef670a5 Author: Bo Li <[email protected]> Date: Tue Sep 19 20:34:18 2023 +0800 ungit something commit 71aa095b4aaebbcaae714850129c5e3579e58be4 Author: Bo Li <[email protected]> Date: Tue Sep 19 20:33:40 2023 +0800 ungit something commit 40555f60551e4087bfa42909eec700da60f2eb4d Author: Bo Li <[email protected]> Date: Tue Sep 19 20:33:37 2023 +0800 ungit something commit 7a7e7f91f278e4eb5f58eef9c5f9c69718b82049 Author: Bo Li <[email protected]> Date: Tue Sep 19 20:28:45 2023 +0800 black format update commit 067c4778894e0cdb5f2fe102e146031382209c89 Author: Li Bo <[email protected]> Date: Tue Sep 19 12:27:19 2023 +0000 add task_group in data batch commit e85d9663d8b84433d70bc23b05268f2033fbe26b Author: Li Bo <[email protected]> Date: Tue Sep 19 10:22:12 2023 +0000 update commit b9c1f74862c8efbbd5e1c239598aeef6bf82e3da Author: Li Bo <[email protected]> Date: Tue Sep 19 09:55:40 2023 +0000 update to cycle dataloader commit 5e2c4e8ae07ebdafb95c99a4cf80090b8ddd7a37 Author: Li Bo <[email protected]> Date: Tue Sep 19 09:07:50 2023 +0000 update commit 385992ac5de4e21612d705ea14c0b79297862607 Author: Bo Li <[email protected]> Date: Tue Sep 19 14:51:01 2023 +0800 clean commit 606b34ffb676a68eb3dc6762f3b53db8e5836c62 Author: Li Bo <[email protected]> Date: Tue Sep 19 06:33:20 2023 +0000 update commit 65bc51ad1fe531beb011cb48c0306ca84adaf3a3 Author: Li Bo <[email protected]> Date: Tue Sep 19 06:12:23 2023 +0000 refactor code to make structure cleaner commit f73852f87e0bfcffa10fa011169046fc995e11be Author: Li Bo <[email protected]> Date: Tue Sep 19 05:35:06 2023 +0000 update commit 382939c6a3a7fcb36bbce0affcbc9fdafc3f27f8 Author: Li Bo <[email protected]> Date: Tue Sep 19 05:25:48 2023 +0000 update commit 5072ed334149469512411aefc0a6f2f3ab93b2b7 Author: Li Bo <[email protected]> Date: Tue Sep 19 05:19:47 2023 +0000 update commit d7f69928fc7200cf8774e7b7cc38b9c51e63bad5 Author: Li Bo <[email protected]> Date: Tue Sep 19 05:18:38 2023 +0000 update demo stage code commit 147d198ecabee16d02162d52e425ff5713e4b7a7 Author: Bo Li <[email protected]> Date: Tue Sep 19 10:51:01 2023 +0800 update commit 36b98202f6038f1f75cb9c54a1597ff012d0a42f Author: Bo Li <[email protected]> Date: Tue Sep 19 10:50:54 2023 +0800 update commit 1ddcde80023c35f5a9f8737ad349f3096fa572dc Merge: 403206f 6315c5d Author: Li Bo <[email protected]> Date: Mon Sep 18 19:04:08 2023 +0000 Merge branch 'dev/data-mixture' of https://github.com/Luodian/Otter-2 into dev/data-mixture commit 403206f8e19ffc243ec131cf59f0646afdccce32 Author: Li Bo <[email protected]> Date: Mon Sep 18 19:04:06 2023 +0000 update commit 6315c5d33e06a01e49e8dac16eb783efcb8f49d4 Author: Bo Li <[email protected]> Date: Tue Sep 19 03:02:12 2023 +0800 update training recipe in shai instance commit e6d1e1542ced0aac1a6a6c9f4b848625253c28e7 Author: Li Bo <[email protected]> Date: Mon Sep 18 18:02:55 2023 +0000 fix commit 542de84645821b82b66de8c886211d549a5f3c07 Author: Li Bo <[email protected]> Date: Mon Sep 18 17:58:24 2023 +0000 update printing logic commit bc993e35a681ded7302442eaa7e5affa55aff957 Author: Li Bo <[email protected]> Date: Mon Sep 18 17:32:36 2023 +0000 refactor saving logic commit 913a41605d92b26b1d47273a881241dd6d164fff Author: Li Bo <[email protected]> Date: Mon Sep 18 17:26:49 2023 +0000 refactor training code commit b9e41cf9e02c5f42b5ef81786ecccffdc1b0db7e Author: Li Bo <[email protected]> Date: Mon Sep 18 17:18:30 2023 +0000 rebase train args
commit d1f17084057daef06a740785aca67c113fa8f19a Author: ZhangYuanhan-AI <[email protected]> Date: Thu Sep 21 15:32:05 2023 +0800 update commit 0ee4bd813549169c2f4f1a62b0613cddf06db859 Author: ZhangYuanhan-AI <[email protected]> Date: Thu Sep 21 14:32:36 2023 +0800 update commit 66fce60846339b8216f00e8eb9a5ef29aa306a92 Author: ZhangYuanhan-AI <[email protected]> Date: Thu Sep 21 14:27:43 2023 +0800 update commit 81b78873e797a4e27f7c20cbe7a9dd182da092a5 Author: ZhangYuanhan-AI <[email protected]> Date: Thu Sep 21 14:22:48 2023 +0800 black commit 69f7e27e70cdbce1f8946a252244fbc72cd7ca89 Author: ZhangYuanhan-AI <[email protected]> Date: Thu Sep 21 14:21:19 2023 +0800 update commit e4cdfb2ca94f0b4d8eb2ef428ca73b654972c5d9 Author: ZhangYuanhan-AI <[email protected]> Date: Thu Sep 21 10:18:36 2023 +0800 update commit 59e9d40fbd01303999d643bb8da5d4411d298f49 Author: ZhangYuanhan-AI <[email protected]> Date: Wed Sep 20 22:22:03 2023 +0800 black commit 1ee45e07fcdb043bba4456b86ca9712baf3887f9 Author: ZhangYuanhan-AI <[email protected]> Date: Wed Sep 20 22:15:56 2023 +0800 update commit be4686c2f358cbe1426741924e995fa788c039e6 Merge: 6a48a32 f1e7e7e Author: ZhangYuanhan-AI <[email protected]> Date: Wed Sep 20 22:13:21 2023 +0800 merge from kc(frozenBilm) commit 6a48a32e61258c3de53459ae7b215cd4b89a9a1b Author: ZhangYuanhan-AI <[email protected]> Date: Wed Sep 20 21:45:31 2023 +0800 update commit 75f8d9accaf191db6c8829b3925a40bc1ba9e609 Author: ZhangYuanhan-AI <[email protected]> Date: Tue Sep 19 20:37:35 2023 +0800 update commit f1e7e7eca856a7bffddf5e5946f92c4377dcfaad Author: kcz358 <[email protected]> Date: Fri Sep 15 21:48:43 2023 +0800 Adding FrozenBiLM and revise base_model
[eval] SeedBench eval dataset and forward method
commit 98fee55b4487e2be256d34c0ae6521714cfefb94 Author: Li Bo <[email protected]> Date: Wed Sep 20 18:05:15 2023 +0000 update benchmark script commit 9090ffd7eb146a17a2d1de6f55d73b4198c32a78 Author: Li Bo <[email protected]> Date: Wed Sep 20 17:39:06 2023 +0000 reuse the traditional way to log inference scripts commit 28bbf8b08a03f9d95eee0982de4464819a761b72 Author: Li Bo <[email protected]> Date: Wed Sep 20 17:22:39 2023 +0000 update dual output commit f231750bd7ae08857e331ecdede850b12940f9ae Author: Li Bo <[email protected]> Date: Wed Sep 20 16:56:17 2023 +0000 update commit 636d3946756af469b341fd8d5ac4f7281fcaa6c4 Author: Li Bo <[email protected]> Date: Wed Sep 20 16:52:37 2023 +0000 update commit e8570413d9ac4d54b936d3490293e0bfe7ea8e89 Author: Li Bo <[email protected]> Date: Wed Sep 20 16:21:56 2023 +0000 update inference formatting commit d4effe0a0210d99a4653b2c56433962c6341fa3d Author: Li Bo <[email protected]> Date: Wed Sep 20 01:19:01 2023 +0000 update commit bf20249a716b212dea68dc047aff198b6022419a Author: Li Bo <[email protected]> Date: Wed Sep 20 01:18:59 2023 +0000 update commit f75c4285588ce96ee227d2e3c9d9b64a5ac6e668 Author: Li Bo <[email protected]> Date: Tue Sep 19 17:33:49 2023 +0000 update commit e530f75fceb9dc259324fd7a76d5fa38dec606b9 Merge: 43f7506 cf31407 Author: Li Bo <[email protected]> Date: Tue Sep 19 12:54:52 2023 +0000 Merge branch 'dev/data-mixture' of https://github.com/Luodian/Otter-2 into dev/data-mixture commit 43f75064cddea24baa12091de2185363e8aaf155 Author: Li Bo <[email protected]> Date: Tue Sep 19 12:54:50 2023 +0000 update key to mimicit data class commit cf31407c160ff9ab8cbd67d220c304756c1a8ab8 Author: Bo Li <[email protected]> Date: Tue Sep 19 20:34:22 2023 +0800 ungit something commit 4bccdf62dea911d01f442beb63e1c46f2ef670a5 Author: Bo Li <[email protected]> Date: Tue Sep 19 20:34:18 2023 +0800 ungit something commit 71aa095b4aaebbcaae714850129c5e3579e58be4 Author: Bo Li <[email protected]> Date: Tue Sep 19 20:33:40 2023 +0800 ungit something commit 40555f60551e4087bfa42909eec700da60f2eb4d Author: Bo Li <[email protected]> Date: Tue Sep 19 20:33:37 2023 +0800 ungit something commit 7a7e7f91f278e4eb5f58eef9c5f9c69718b82049 Author: Bo Li <[email protected]> Date: Tue Sep 19 20:28:45 2023 +0800 black format update commit 067c4778894e0cdb5f2fe102e146031382209c89 Author: Li Bo <[email protected]> Date: Tue Sep 19 12:27:19 2023 +0000 add task_group in data batch commit e85d9663d8b84433d70bc23b05268f2033fbe26b Author: Li Bo <[email protected]> Date: Tue Sep 19 10:22:12 2023 +0000 update commit b9c1f74862c8efbbd5e1c239598aeef6bf82e3da Author: Li Bo <[email protected]> Date: Tue Sep 19 09:55:40 2023 +0000 update to cycle dataloader commit 5e2c4e8ae07ebdafb95c99a4cf80090b8ddd7a37 Author: Li Bo <[email protected]> Date: Tue Sep 19 09:07:50 2023 +0000 update commit 385992ac5de4e21612d705ea14c0b79297862607 Author: Bo Li <[email protected]> Date: Tue Sep 19 14:51:01 2023 +0800 clean commit 606b34ffb676a68eb3dc6762f3b53db8e5836c62 Author: Li Bo <[email protected]> Date: Tue Sep 19 06:33:20 2023 +0000 update commit 65bc51ad1fe531beb011cb48c0306ca84adaf3a3 Author: Li Bo <[email protected]> Date: Tue Sep 19 06:12:23 2023 +0000 refactor code to make structure cleaner commit f73852f87e0bfcffa10fa011169046fc995e11be Author: Li Bo <[email protected]> Date: Tue Sep 19 05:35:06 2023 +0000 update commit 382939c6a3a7fcb36bbce0affcbc9fdafc3f27f8 Author: Li Bo <[email protected]> Date: Tue Sep 19 05:25:48 2023 +0000 update commit 5072ed334149469512411aefc0a6f2f3ab93b2b7 Author: Li Bo <[email protected]> Date: Tue Sep 19 05:19:47 2023 +0000 update commit d7f69928fc7200cf8774e7b7cc38b9c51e63bad5 Author: Li Bo <[email protected]> Date: Tue Sep 19 05:18:38 2023 +0000 update demo stage code commit 147d198ecabee16d02162d52e425ff5713e4b7a7 Author: Bo Li <[email protected]> Date: Tue Sep 19 10:51:01 2023 +0800 update commit 36b98202f6038f1f75cb9c54a1597ff012d0a42f Author: Bo Li <[email protected]> Date: Tue Sep 19 10:50:54 2023 +0800 update commit 1ddcde80023c35f5a9f8737ad349f3096fa572dc Merge: 403206f 6315c5d Author: Li Bo <[email protected]> Date: Mon Sep 18 19:04:08 2023 +0000 Merge branch 'dev/data-mixture' of https://github.com/Luodian/Otter-2 into dev/data-mixture commit 403206f8e19ffc243ec131cf59f0646afdccce32 Author: Li Bo <[email protected]> Date: Mon Sep 18 19:04:06 2023 +0000 update commit 6315c5d33e06a01e49e8dac16eb783efcb8f49d4 Author: Bo Li <[email protected]> Date: Tue Sep 19 03:02:12 2023 +0800 update training recipe in shai instance commit e6d1e1542ced0aac1a6a6c9f4b848625253c28e7 Author: Li Bo <[email protected]> Date: Mon Sep 18 18:02:55 2023 +0000 fix commit 542de84645821b82b66de8c886211d549a5f3c07 Author: Li Bo <[email protected]> Date: Mon Sep 18 17:58:24 2023 +0000 update printing logic commit bc993e35a681ded7302442eaa7e5affa55aff957 Author: Li Bo <[email protected]> Date: Mon Sep 18 17:32:36 2023 +0000 refactor saving logic commit 913a41605d92b26b1d47273a881241dd6d164fff Author: Li Bo <[email protected]> Date: Mon Sep 18 17:26:49 2023 +0000 refactor training code commit b9e41cf9e02c5f42b5ef81786ecccffdc1b0db7e Author: Li Bo <[email protected]> Date: Mon Sep 18 17:18:30 2023 +0000 rebase train args
Merge Main branch
* docs(README.md): update information on added support for using Azure, Anthropic, Palm, Cohere models for Self-Instruct with Syphus pipeline
* feat(README.md): add corresponding checkpoints section * feat(README.md): add update section for 2023-11 * feat(README.md): add update section for 2023-08 * docs(README.md): update Otter model details section * docs(README.md): update environments section * docs(README.md): update training section * docs(README.md): add citation section
…or_path to use relative path instead of absolute path
…d SFT * feat(README.md): add SVIT to the list of training datasets for SFT * docs(README.md): update benchmark interface and add details about running benchmarks in one-click * docs(README.md): add information about code refactorization for managing datasets in MIMIC-IT format
* datapath * lint * lint * Merge commit '5ad27a91061cdd3a94d92a4bc024b2479e7f2604' * science qa * lint --------- Co-authored-by: Li Bo <[email protected]>
* zoominbench * lint * phrase * Squashed commit of the following: commit 8908a176208bf95d3201f9cd92c0bb346be4b9de Author: Li Bo <[email protected]> Date: Sun Nov 5 14:16:01 2023 +0000 updates commit c02d141ac6bc93243bf3de8a62fee634a40fdbd1 Author: Li Bo <[email protected]> Date: Sun Nov 5 14:15:12 2023 +0000 * chore(README.md): fix link formatting for Otter-AI in the list of models commit ee8ca544b4badb579a2ca3419b2732688c6f418f Author: Li Bo <[email protected]> Date: Sun Nov 5 14:14:13 2023 +0000 * docs(README.md): update training datasets interface for Pretrain and SFT * feat(README.md): add SVIT to the list of training datasets for SFT * docs(README.md): update benchmark interface and add details about running benchmarks in one-click * docs(README.md): add information about code refactorization for managing datasets in MIMIC-IT format commit e63d386fb0f36adaec12198e831c93f041c96178 Author: Li Bo <[email protected]> Date: Sun Nov 5 12:02:06 2023 +0000 * fix(Demo_OtterHD.sh): update the path of the pretrained_model_name_or_path to use relative path instead of absolute path commit a47b337959eddbfd51e311af43ca3960c6c1e8de Author: Li Bo <[email protected]> Date: Sun Nov 5 12:00:44 2023 +0000 * chore(README.md): fix formatting and remove unnecessary comments * feat(README.md): add corresponding checkpoints section * feat(README.md): add update section for 2023-11 * feat(README.md): add update section for 2023-08 * docs(README.md): update Otter model details section * docs(README.md): update environments section * docs(README.md): update training section * docs(README.md): add citation section commit e9ecacf2d5d55c4d2ced61eb15f5b8a6d37128e0 Author: Li Bo <[email protected]> Date: Sun Nov 5 12:00:13 2023 +0000 updates commit 61bcdee6190d9e29024ac0d98c9efdba7cd7e0d7 Author: Li Bo <[email protected]> Date: Sun Nov 5 11:58:54 2023 +0000 * chore(README.md): fix typo in code refactorization description * docs(README.md): update information on added support for using Azure, Anthropic, Palm, Cohere models for Self-Instruct with Syphus pipeline commit da208280d48250d4a66726fa5c64b66792b70543 Author: Li Bo <[email protected]> Date: Sun Nov 5 11:55:58 2023 +0000 * feat(docs): add documentation for MIMIC-IT format and Demo_Data.yaml file * docs(mimicit_format.md): add explanation of MIMIC-IT format and its structure * docs(mimicit_format.md): provide example of DallE3_instructions.json and DallE3_images.parquet * docs(mimicit_format.md): explain the switch from images.json to parquet format * docs(Demo_Data.yaml): uncomment LADD and LACR_T2T datasets in IMAGE_TEXT group commit 600f1a1324aa979794357aa2493c2ed0f4e92dfa Merge: 13fe08f c318152 Author: Li Bo <[email protected]> Date: Sun Nov 5 11:30:39 2023 +0000 Merge branch 'main_dev' of https://github.com/Luodian/Otter-2 into main_dev commit c3181521cb3c9232bb0ba7ce1a21db8dc313262f Author: Zhang Peiyuan <[email protected]> Date: Sun Nov 5 19:30:48 2023 +0800 Update Installation (#38) * Update Installation * Update OtterHD.md * Update OtterHD.md --------- Co-authored-by: Li Bo <[email protected]> commit 13fe08f56bc7b020bab64ec833c659f8a6bdcea3 Author: Li Bo <[email protected]> Date: Sun Nov 5 11:30:37 2023 +0000 updates commit 88d23d0e8266fb9722776d7353bfd7719d1e868b Author: Li Bo <[email protected]> Date: Sun Nov 5 11:25:34 2023 +0000 updates commit 4a9b010454e4affe54c1b0d7c615a74aeae2f1e7 Author: Li Bo <[email protected]> Date: Sun Nov 5 11:24:59 2023 +0000 * chore(benchmark_eval.md): update benchmark evaluation page * * feat(benchmark_eval.md): add information about potential issues with running models * * feat(benchmark_eval.md): add support for additional datasets (mme, pope, mmvet, mathvista, mmbench) * * feat(benchmark_eval.md): add support for new model (fuyu) commit 8049c755b85013a2e74f712e9ac96a9ad1c9fa1e Author: Li Bo <[email protected]> Date: Sun Nov 5 11:21:58 2023 +0000 * chore(README.md): remove unnecessary comments and update OtterHD Paper link * docs(OtterHD.md): update evaluation instructions and add benchmark.yaml example * docs(benchmark_eval.md): create benchmark evaluation page * refactor(base_eval_dataset.py): remove unused import * refactor(mhbench.py): remove unused code * refactor(zoominbench.py): remove unused code * refactor(base_eval_dataset.py): remove unused import * refactor(otterhd.py): rename otterbite.py to otterhd.py commit d8c21831e5b6d809d634593c37f2eec809d41807 Author: Li Bo <[email protected]> Date: Sun Nov 5 11:12:11 2023 +0000 updates commit 06566d3db104ae3cd9add090c863ed320d322a1e Author: Li Bo <[email protected]> Date: Sun Nov 5 11:11:45 2023 +0000 updates commit de2b96888d7f7f7dc6f472d55442c6090d7f1063 Author: Li Bo <[email protected]> Date: Sun Nov 5 11:11:02 2023 +0000 updates commit 3eca7f698a4b372338d4139ad0862760d1793c2a Author: Li Bo <[email protected]> Date: Sun Nov 5 11:10:00 2023 +0000 * docs(README.md): remove outdated feature updates and add new information about MIMIC-IT dataset and contact for development assistance commit bbc38be1a7e4ba80a774b3fe67e3be8a21303865 Author: Li Bo <[email protected]> Date: Sun Nov 5 11:08:54 2023 +0000 * chore: update training script parameters in README.md * docs: update link to modified Fuyu-8B implementation in OtterHD.md * fix: remove unused import in fuyu.py commit 734cce7dfcae87f468a8ab0e427320945b0c7d33 Author: Li Bo <[email protected]> Date: Sun Nov 5 11:04:05 2023 +0000 * feat(README.md): add OtterHD and MagnifierBench sections * chore(README.md): improve pipeline for Pretrain/SFT/RLHF * chore(README.md): refactor code for organizing multiple datasets * feat(README.md): add support for using Azure, Anthropic, Palm, Cohere models for Self-Instruct with Syphus pipeline commit 4be489dd772ca6ecef54e7f3ae32e1ba9e995c6a Author: Li Bo <[email protected]> Date: Sun Nov 5 11:02:01 2023 +0000 * chore(README.md): reformat bullet points in the changelog section * feat(README.md): add support for using Azure, Anthropic, Palm, Cohere models for Self-Instruct with Syphus pipeline commit a4fa7467e6e74a4ae1c2c62715033b55cb4864ec Author: Li Bo <[email protected]> Date: Sun Nov 5 11:01:16 2023 +0000 update commit f2e93207ddfb69307e43a5cae5747d5bd328e7f6 Author: Li Bo <[email protected]> Date: Sun Nov 5 09:03:56 2023 +0000 * fix(instruction_following.py): remove commented import statement and unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py): remove unnecessary whitespace * fix(instruction_following.py commit 9cfcf7137c249359b07c520661ac9f02ec874023 Merge: 75a9467 5b5567c Author: Li Bo <[email protected]> Date: Sun Nov 5 09:02:50 2023 +0000 Merge branch 'main_dev' of https://github.com/Luodian/Otter-2 into main_dev commit 5b5567caf6137d75e9012de706e0df0cc7406041 Author: Zhang Peiyuan <[email protected]> Date: Sun Nov 5 17:01:23 2023 +0800 Dev/merging main and fuyu wip (#37) * Merge commit '2d29a417d9e96251be33edda0b0637647882c31b' * Conflicts: pipeline/mimicit_utils/mimicit_dataset.py * update mpt config * fix training padding * update fix * Squashed commit of the following: commit e4f1ec3b287c026a6212a88316d7341883195294 Author: Li Bo <[email protected]> Date: Tue Oct 10 13:47:47 2023 +0000 update output path commit 1a8e12bfa21697188eaa7a4ed6169223e0f92258 Author: Li Bo <[email protected]> Date: Tue Oct 10 12:23:02 2023 +0000 update naming rule commit 537d239e3b4109c552a94b80a7bde3bb8a7b107d Author: Li Bo <[email protected]> Date: Tue Oct 10 09:10:47 2023 +0000 fix bug in mme eval commit 0c7eacb6ebef4d55187d67b06c88cd504ef17dbd Author: Li Bo <[email protected]> Date: Tue Oct 10 14:36:55 2023 +0800 Dev/mathvista (#21) * for mathvista * add time info * black lint code * update * update test config * stage updates * update mathvista eval * update mathvista * better format prompt commit c07f73f6c868444fd784e5844134dc0cccaa566d Author: Li Bo <[email protected]> Date: Tue Oct 10 06:33:08 2023 +0000 update mme saving logic commit dce1b0f30a390ace45bcf579d93764847848ee51 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:28:29 2023 +0000 fix mme commit b970f617bea2b418cf726a50b4cd008dc7eb4907 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:11:03 2023 +0000 prepare commit 33e6cb0f0212ed845ca17956743926b4d53ec0f3 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:09:57 2023 +0000 resolve idefics for seedbench eval commit fc2a87bc853a34ce8bfb16b7f6a504a1d63af0e5 Author: Li Bo <[email protected]> Date: Tue Oct 10 12:19:06 2023 +0800 Dev/refactor (#20) * seedbench_eval * update seedbench eval for idefics * update * resolve input for seedbench * update --------- Co-authored-by: Joshua Adrian Cahyono <[email protected]> commit edb2440eec77c6c07ed5457a1251e567e57b88f2 Author: JvThunder <[email protected]> Date: Tue Oct 10 02:42:27 2023 +0800 seedbench_eval (#19) * seedbench_eval * update seedbench eval for idefics * update --------- Co-authored-by: Li Bo <[email protected]> commit 39264fc8f0781057de820c122f31fc60ac2f301f Author: Pu Fanyi <[email protected]> Date: Mon Oct 9 20:08:29 2023 +0800 [Eval] MMVet Eval (#18) * prepare dataset * MME * add mmvet dataset * git ignore * MMVet * lint * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler --------- Co-authored-by: Li Bo <[email protected]> commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update * migrates * Squashed commit of the following: commit 52bacca3d858d2ac32f44f8b1619ce5064ae1a28 Author: Li Bo <[email protected]> Date: Thu Oct 12 10:44:46 2023 +0000 update configs and demo evals commit a41247d193b3ca0967c38d0b3b11e2a04ebf9ca7 Merge: 9ff5957 34b70f8 Author: Li Bo <[email protected]> Date: Thu Oct 12 10:02:24 2023 +0000 Merge branch 'main_dev' of https://github.com/Luodian/Otter-2 into main_dev commit 9ff5957c01349e58b60154f469ae3ee6c8c30555 Author: Li Bo <[email protected]> Date: Thu Oct 12 08:52:22 2023 +0000 mathvista commit 34b70f8068cfd5fbdc36980e6ac5215942849723 Author: Pu Fanyi <[email protected]> Date: Thu Oct 12 15:56:08 2023 +0800 generate results.json for seedbench (#24) commit 19fdf40a3f0cd05551f482f9834e38f9210256a3 Author: Li Bo <[email protected]> Date: Thu Oct 12 02:04:38 2023 +0000 black lint commit 01d56cec48f65307ed33e2a2dbd853717464e51f Author: Li Bo <[email protected]> Date: Thu Oct 12 02:02:52 2023 +0000 better design for idefics model to integrate multi-types data commit 1a0972e6cc283af4099f0c85d907c3ec61a36224 Author: Li Bo <[email protected]> Date: Wed Oct 11 18:28:19 2023 +0000 hardcode enabling flash commit cf11867f2bb1a7c50c863eb2b438a588acf4f733 Author: Pu Fanyi <[email protected]> Date: Thu Oct 12 00:55:23 2023 +0800 [evaluation] Fix mmvet output (#23) * fix mmvet * lint commit 54362e9de5c0ead2d622544dea8802fd62db19ce Author: Li Bo <[email protected]> Date: Wed Oct 11 07:47:32 2023 +0000 fix images input for idefics model commit 96e467c0480cca1abd86ac723f8b33260c49b1a1 Author: Bo Li <[email protected]> Date: Wed Oct 11 15:20:04 2023 +0800 idefics full finetune commit 11be13deb2c5e57b392d289670237714cdb5b012 Author: Bo Li <[email protected]> Date: Wed Oct 11 13:22:32 2023 +0800 also train vision encoder commit 3dfcf3e9a468897d1a251163d13a4a5de7542a64 Author: Li Bo <[email protected]> Date: Tue Oct 10 14:13:40 2023 +0000 fix video training commit b8a086bcbe43e5debd85fab2db11610df513558f Author: Li Bo <[email protected]> Date: Tue Oct 10 21:53:29 2023 +0800 Dev/train (#22) * Merge commit '2d29a417d9e96251be33edda0b0637647882c31b' * Conflicts: pipeline/mimicit_utils/mimicit_dataset.py * update mpt config * fix training padding * update fix * Squashed commit of the following: commit e4f1ec3b287c026a6212a88316d7341883195294 Author: Li Bo <[email protected]> Date: Tue Oct 10 13:47:47 2023 +0000 update output path commit 1a8e12bfa21697188eaa7a4ed6169223e0f92258 Author: Li Bo <[email protected]> Date: Tue Oct 10 12:23:02 2023 +0000 update naming rule commit 537d239e3b4109c552a94b80a7bde3bb8a7b107d Author: Li Bo <[email protected]> Date: Tue Oct 10 09:10:47 2023 +0000 fix bug in mme eval commit 0c7eacb6ebef4d55187d67b06c88cd504ef17dbd Author: Li Bo <[email protected]> Date: Tue Oct 10 14:36:55 2023 +0800 Dev/mathvista (#21) * for mathvista * add time info * black lint code * update * update test config * stage updates * update mathvista eval * update mathvista * better format prompt commit c07f73f6c868444fd784e5844134dc0cccaa566d Author: Li Bo <[email protected]> Date: Tue Oct 10 06:33:08 2023 +0000 update mme saving logic commit dce1b0f30a390ace45bcf579d93764847848ee51 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:28:29 2023 +0000 fix mme commit b970f617bea2b418cf726a50b4cd008dc7eb4907 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:11:03 2023 +0000 prepare commit 33e6cb0f0212ed845ca17956743926b4d53ec0f3 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:09:57 2023 +0000 resolve idefics for seedbench eval commit fc2a87bc853a34ce8bfb16b7f6a504a1d63af0e5 Author: Li Bo <[email protected]> Date: Tue Oct 10 12:19:06 2023 +0800 Dev/refactor (#20) * seedbench_eval * update seedbench eval for idefics * update * resolve input for seedbench * update --------- Co-authored-by: Joshua Adrian Cahyono <[email protected]> commit edb2440eec77c6c07ed5457a1251e567e57b88f2 Author: JvThunder <[email protected]> Date: Tue Oct 10 02:42:27 2023 +0800 seedbench_eval (#19) * seedbench_eval * update seedbench eval for idefics * update --------- Co-authored-by: Li Bo <[email protected]> commit 39264fc8f0781057de820c122f31fc60ac2f301f Author: Pu Fanyi <[email protected]> Date: Mon Oct 9 20:08:29 2023 +0800 [Eval] MMVet Eval (#18) * prepare dataset * MME * add mmvet dataset * git ignore * MMVet * lint * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler --------- Co-authored-by: Li Bo <[email protected]> commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update * update * Squashed commit of the following: commit 94177061ff29e8c395ae63d408f64297cfa09211 Author: JvThunder <[email protected]> Date: Fri Oct 13 11:42:56 2023 +0800 Dev/refactor (#26) * seedbench_eval * update seedbench eval for idefics * update * resolve input for seedbench * update * make_submission_seedbench * pope_eval * update_pope_eval * update_pope * black linta --------- Co-authored-by: Li Bo <[email protected]> commit 52bacca3d858d2ac32f44f8b1619ce5064ae1a28 Author: Li Bo <[email protected]> Date: Thu Oct 12 10:44:46 2023 +0000 update configs and demo evals commit a41247d193b3ca0967c38d0b3b11e2a04ebf9ca7 Merge: 9ff5957 34b70f8 Author: Li Bo <[email protected]> Date: Thu Oct 12 10:02:24 2023 +0000 Merge branch 'main_dev' of https://github.com/Luodian/Otter-2 into main_dev commit 9ff5957c01349e58b60154f469ae3ee6c8c30555 Author: Li Bo <[email protected]> Date: Thu Oct 12 08:52:22 2023 +0000 mathvista commit 34b70f8068cfd5fbdc36980e6ac5215942849723 Author: Pu Fanyi <[email protected]> Date: Thu Oct 12 15:56:08 2023 +0800 generate results.json for seedbench (#24) commit 19fdf40a3f0cd05551f482f9834e38f9210256a3 Author: Li Bo <[email protected]> Date: Thu Oct 12 02:04:38 2023 +0000 black lint commit 01d56cec48f65307ed33e2a2dbd853717464e51f Author: Li Bo <[email protected]> Date: Thu Oct 12 02:02:52 2023 +0000 better design for idefics model to integrate multi-types data commit 1a0972e6cc283af4099f0c85d907c3ec61a36224 Author: Li Bo <[email protected]> Date: Wed Oct 11 18:28:19 2023 +0000 hardcode enabling flash commit cf11867f2bb1a7c50c863eb2b438a588acf4f733 Author: Pu Fanyi <[email protected]> Date: Thu Oct 12 00:55:23 2023 +0800 [evaluation] Fix mmvet output (#23) * fix mmvet * lint commit 54362e9de5c0ead2d622544dea8802fd62db19ce Author: Li Bo <[email protected]> Date: Wed Oct 11 07:47:32 2023 +0000 fix images input for idefics model commit 96e467c0480cca1abd86ac723f8b33260c49b1a1 Author: Bo Li <[email protected]> Date: Wed Oct 11 15:20:04 2023 +0800 idefics full finetune commit 11be13deb2c5e57b392d289670237714cdb5b012 Author: Bo Li <[email protected]> Date: Wed Oct 11 13:22:32 2023 +0800 also train vision encoder commit 3dfcf3e9a468897d1a251163d13a4a5de7542a64 Author: Li Bo <[email protected]> Date: Tue Oct 10 14:13:40 2023 +0000 fix video training commit b8a086bcbe43e5debd85fab2db11610df513558f Author: Li Bo <[email protected]> Date: Tue Oct 10 21:53:29 2023 +0800 Dev/train (#22) * Merge commit '2d29a417d9e96251be33edda0b0637647882c31b' * Conflicts: pipeline/mimicit_utils/mimicit_dataset.py * update mpt config * fix training padding * update fix * Squashed commit of the following: commit e4f1ec3b287c026a6212a88316d7341883195294 Author: Li Bo <[email protected]> Date: Tue Oct 10 13:47:47 2023 +0000 update output path commit 1a8e12bfa21697188eaa7a4ed6169223e0f92258 Author: Li Bo <[email protected]> Date: Tue Oct 10 12:23:02 2023 +0000 update naming rule commit 537d239e3b4109c552a94b80a7bde3bb8a7b107d Author: Li Bo <[email protected]> Date: Tue Oct 10 09:10:47 2023 +0000 fix bug in mme eval commit 0c7eacb6ebef4d55187d67b06c88cd504ef17dbd Author: Li Bo <[email protected]> Date: Tue Oct 10 14:36:55 2023 +0800 Dev/mathvista (#21) * for mathvista * add time info * black lint code * update * update test config * stage updates * update mathvista eval * update mathvista * better format prompt commit c07f73f6c868444fd784e5844134dc0cccaa566d Author: Li Bo <[email protected]> Date: Tue Oct 10 06:33:08 2023 +0000 update mme saving logic commit dce1b0f30a390ace45bcf579d93764847848ee51 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:28:29 2023 +0000 fix mme commit b970f617bea2b418cf726a50b4cd008dc7eb4907 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:11:03 2023 +0000 prepare commit 33e6cb0f0212ed845ca17956743926b4d53ec0f3 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:09:57 2023 +0000 resolve idefics for seedbench eval commit fc2a87bc853a34ce8bfb16b7f6a504a1d63af0e5 Author: Li Bo <[email protected]> Date: Tue Oct 10 12:19:06 2023 +0800 Dev/refactor (#20) * seedbench_eval * update seedbench eval for idefics * update * resolve input for seedbench * update --------- Co-authored-by: Joshua Adrian Cahyono <[email protected]> commit edb2440eec77c6c07ed5457a1251e567e57b88f2 Author: JvThunder <[email protected]> Date: Tue Oct 10 02:42:27 2023 +0800 seedbench_eval (#19) * seedbench_eval * update seedbench eval for idefics * update --------- Co-authored-by: Li Bo <[email protected]> commit 39264fc8f0781057de820c122f31fc60ac2f301f Author: Pu Fanyi <[email protected]> Date: Mon Oct 9 20:08:29 2023 +0800 [Eval] MMVet Eval (#18) * prepare dataset * MME * add mmvet dataset * git ignore * MMVet * lint * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler --------- Co-authored-by: Li Bo <[email protected]> commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update * update saved dir * prompt fix * avoid divide zero error * visible response * Squashed commit of the following: commit 1e505b4dcc53e5d7fc500426607f32985a326dbd Author: Li Bo <[email protected]> Date: Sat Oct 14 12:08:09 2023 +0800 [Eval] (#27) * Merge commit '2d29a417d9e96251be33edda0b0637647882c31b' * Conflicts: pipeline/mimicit_utils/mimicit_dataset.py * update mpt config * fix training padding * update fix * Squashed commit of the following: commit e4f1ec3b287c026a6212a88316d7341883195294 Author: Li Bo <[email protected]> Date: Tue Oct 10 13:47:47 2023 +0000 update output path commit 1a8e12bfa21697188eaa7a4ed6169223e0f92258 Author: Li Bo <[email protected]> Date: Tue Oct 10 12:23:02 2023 +0000 update naming rule commit 537d239e3b4109c552a94b80a7bde3bb8a7b107d Author: Li Bo <[email protected]> Date: Tue Oct 10 09:10:47 2023 +0000 fix bug in mme eval commit 0c7eacb6ebef4d55187d67b06c88cd504ef17dbd Author: Li Bo <[email protected]> Date: Tue Oct 10 14:36:55 2023 +0800 Dev/mathvista (#21) * for mathvista * add time info * black lint code * update * update test config * stage updates * update mathvista eval * update mathvista * better format prompt commit c07f73f6c868444fd784e5844134dc0cccaa566d Author: Li Bo <[email protected]> Date: Tue Oct 10 06:33:08 2023 +0000 update mme saving logic commit dce1b0f30a390ace45bcf579d93764847848ee51 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:28:29 2023 +0000 fix mme commit b970f617bea2b418cf726a50b4cd008dc7eb4907 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:11:03 2023 +0000 prepare commit 33e6cb0f0212ed845ca17956743926b4d53ec0f3 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:09:57 2023 +0000 resolve idefics for seedbench eval commit fc2a87bc853a34ce8bfb16b7f6a504a1d63af0e5 Author: Li Bo <[email protected]> Date: Tue Oct 10 12:19:06 2023 +0800 Dev/refactor (#20) * seedbench_eval * update seedbench eval for idefics * update * resolve input for seedbench * update --------- Co-authored-by: Joshua Adrian Cahyono <[email protected]> commit edb2440eec77c6c07ed5457a1251e567e57b88f2 Author: JvThunder <[email protected]> Date: Tue Oct 10 02:42:27 2023 +0800 seedbench_eval (#19) * seedbench_eval * update seedbench eval for idefics * update --------- Co-authored-by: Li Bo <[email protected]> commit 39264fc8f0781057de820c122f31fc60ac2f301f Author: Pu Fanyi <[email protected]> Date: Mon Oct 9 20:08:29 2023 +0800 [Eval] MMVet Eval (#18) * prepare dataset * MME * add mmvet dataset * git ignore * MMVet * lint * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler --------- Co-authored-by: Li Bo <[email protected]> commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update * migrates * Squashed commit of the following: commit 52bacca3d858d2ac32f44f8b1619ce5064ae1a28 Author: Li Bo <[email protected]> Date: Thu Oct 12 10:44:46 2023 +0000 update configs and demo evals commit a41247d193b3ca0967c38d0b3b11e2a04ebf9ca7 Merge: 9ff5957 34b70f8 Author: Li Bo <[email protected]> Date: Thu Oct 12 10:02:24 2023 +0000 Merge branch 'main_dev' of https://github.com/Luodian/Otter-2 into main_dev commit 9ff5957c01349e58b60154f469ae3ee6c8c30555 Author: Li Bo <[email protected]> Date: Thu Oct 12 08:52:22 2023 +0000 mathvista commit 34b70f8068cfd5fbdc36980e6ac5215942849723 Author: Pu Fanyi <[email protected]> Date: Thu Oct 12 15:56:08 2023 +0800 generate results.json for seedbench (#24) commit 19fdf40a3f0cd05551f482f9834e38f9210256a3 Author: Li Bo <[email protected]> Date: Thu Oct 12 02:04:38 2023 +0000 black lint commit 01d56cec48f65307ed33e2a2dbd853717464e51f Author: Li Bo <[email protected]> Date: Thu Oct 12 02:02:52 2023 +0000 better design for idefics model to integrate multi-types data commit 1a0972e6cc283af4099f0c85d907c3ec61a36224 Author: Li Bo <[email protected]> Date: Wed Oct 11 18:28:19 2023 +0000 hardcode enabling flash commit cf11867f2bb1a7c50c863eb2b438a588acf4f733 Author: Pu Fanyi <[email protected]> Date: Thu Oct 12 00:55:23 2023 +0800 [evaluation] Fix mmvet output (#23) * fix mmvet * lint commit 54362e9de5c0ead2d622544dea8802fd62db19ce Author: Li Bo <[email protected]> Date: Wed Oct 11 07:47:32 2023 +0000 fix images input for idefics model commit 96e467c0480cca1abd86ac723f8b33260c49b1a1 Author: Bo Li <[email protected]> Date: Wed Oct 11 15:20:04 2023 +0800 idefics full finetune commit 11be13deb2c5e57b392d289670237714cdb5b012 Author: Bo Li <[email protected]> Date: Wed Oct 11 13:22:32 2023 +0800 also train vision encoder commit 3dfcf3e9a468897d1a251163d13a4a5de7542a64 Author: Li Bo <[email protected]> Date: Tue Oct 10 14:13:40 2023 +0000 fix video training commit b8a086bcbe43e5debd85fab2db11610df513558f Author: Li Bo <[email protected]> Date: Tue Oct 10 21:53:29 2023 +0800 Dev/train (#22) * Merge commit '2d29a417d9e96251be33edda0b0637647882c31b' * Conflicts: pipeline/mimicit_utils/mimicit_dataset.py * update mpt config * fix training padding * update fix * Squashed commit of the following: commit e4f1ec3b287c026a6212a88316d7341883195294 Author: Li Bo <[email protected]> Date: Tue Oct 10 13:47:47 2023 +0000 update output path commit 1a8e12bfa21697188eaa7a4ed6169223e0f92258 Author: Li Bo <[email protected]> Date: Tue Oct 10 12:23:02 2023 +0000 update naming rule commit 537d239e3b4109c552a94b80a7bde3bb8a7b107d Author: Li Bo <[email protected]> Date: Tue Oct 10 09:10:47 2023 +0000 fix bug in mme eval commit 0c7eacb6ebef4d55187d67b06c88cd504ef17dbd Author: Li Bo <[email protected]> Date: Tue Oct 10 14:36:55 2023 +0800 Dev/mathvista (#21) * for mathvista * add time info * black lint code * update * update test config * stage updates * update mathvista eval * update mathvista * better format prompt commit c07f73f6c868444fd784e5844134dc0cccaa566d Author: Li Bo <[email protected]> Date: Tue Oct 10 06:33:08 2023 +0000 update mme saving logic commit dce1b0f30a390ace45bcf579d93764847848ee51 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:28:29 2023 +0000 fix mme commit b970f617bea2b418cf726a50b4cd008dc7eb4907 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:11:03 2023 +0000 prepare commit 33e6cb0f0212ed845ca17956743926b4d53ec0f3 Author: Li Bo <[email protected]> Date: Tue Oct 10 06:09:57 2023 +0000 resolve idefics for seedbench eval commit fc2a87bc853a34ce8bfb16b7f6a504a1d63af0e5 Author: Li Bo <[email protected]> Date: Tue Oct 10 12:19:06 2023 +0800 Dev/refactor (#20) * seedbench_eval * update seedbench eval for idefics * update * resolve input for seedbench * update --------- Co-authored-by: Joshua Adrian Cahyono <[email protected]> commit edb2440eec77c6c07ed5457a1251e567e57b88f2 Author: JvThunder <[email protected]> Date: Tue Oct 10 02:42:27 2023 +0800 seedbench_eval (#19) * seedbench_eval * update seedbench eval for idefics * update --------- Co-authored-by: Li Bo <[email protected]> commit 39264fc8f0781057de820c122f31fc60ac2f301f Author: Pu Fanyi <[email protected]> Date: Mon Oct 9 20:08:29 2023 +0800 [Eval] MMVet Eval (#18) * prepare dataset * MME * add mmvet dataset * git ignore * MMVet * lint * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler * Squashed commit of the following: commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update commit cff3f32262bcdba980f84e82b874aa03c05c9027 Author: Bo Li <[email protected]> Date: Sun Oct 8 18:44:22 2023 +0800 explicitly assign constant scheduler --------- Co-authored-by: Li Bo <[email protected]> commit 1da20cf87fccae6e379463e96fffbcfa9ad9c592 Author: Li Bo <[email protected]> Date: Mon Oct 9 02:02:10 2023 +0000 update wandb logging commit 2d29a417d9e96251be33edda0b0637647882c31b Author: Li Bo <[email protected]> Date: Mon Oct 9 01:45:05 2023 +0000 update logging with wandb commit 3b55adba8d52b19fe5fc8acb3c64706793682b02 Author: Li Bo <[email protected]> Date: Mon Oct 9 01:35:25 2023 +0000 update commit b8312afc54915b615fd8319bcffc9e0781af346a Author: Li Bo <[email protected]> Date: Sun Oct 8 14:41:23 2023 +0000 benchmark eval updates commit 956a7cc1f968768b19fbd97490b1a8ff9f6ad1d1 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:28:24 2023 +0000 black lint commit 048778f0de04cb4f08d74f2aaab5da33ce8e69c6 Author: Li Bo <[email protected]> Date: Sun Oct 8 13:27:22 2023 +0000 eval update * update * Squashed commit of the following: commit 94177061ff29e8c395ae63d408f64297cfa09211 Author: JvThunder <[email protected]> Date: Fri Oct 13 11:42:56 2023 +0800 Dev/refactor (#26) * seedbench_eval * update seedbench eval for idefics * update * resolve input for seedbench * update * make_submission_seedbench * pope_eval * update_pope_eval * update_pope * black linta --------- Co-authored-by: Li Bo <[email protected]> commit 52bacca3d858d2ac32f44f8b1619ce5064ae1a28 Author: Li Bo <[email protected]> Date: Thu Oct 12 10:44:46 2023 +0000 update configs and demo evals commit a41247d193b3ca0967c38d0b3b11e2a04ebf9ca7 Merge: 9ff5957 34b70f8 Author: Li Bo <[email protected]> Date: Thu Oct 12 10:02:24 2023 +0000 Merge branch 'main_dev' of https://github.com/Luodian/Otter-2 into main_dev commit 9ff5957c01349e58b60154f469ae3ee6c8c30555 Author: Li Bo <[email protected]> Date: Thu Oct 12 08:52:22 2023 +0000 mathvista commit 34b70f8068cfd5fbdc36980e6ac5215942849723 Author: Pu Fanyi <[email protected]> Date: Thu Oct 12 15:56:08 2023 +0800 generate results.json for seedbench (#24) commit 19fdf40a3f0cd05551f482f9834e38f9210256a3 Author: Li Bo <[email protected]> Date: Thu Oct 12 02:04:38 2023 +0000 black lint commit 01d56cec48f65307ed33e2a2dbd853717464e51f Author: Li Bo <[email protected]> Date: Thu Oct 12 02:02:52 2023 +0000 better design for idefics model to integrate multi-types data commit 1a0972e6cc283af4099f0c85d907c3ec61a36224 Author: Li Bo <[email protected]> Date: Wed Oct 11 18:28:19 2023 +0000 hardcode enabling flash commit cf11867f2bb1a7c50c863eb2b438a588acf4f733 Author: Pu Fanyi <[email protected]> Date: Thu Oct 12 00:55:23 2023 +0800 [evaluation] Fix mmvet output (#23) * fix mmvet * lint commit 54362e9de5c0ead2d622544dea8802fd62db19ce Author: Li Bo <[email protected]> Date: Wed Oct 11 07:47:32 2023 +0000 fix images input for idefics model commit 96e467c0480cca1abd86ac723f8b33260c49b1a1 Author: Bo Li <[email protected]> Date: Wed Oct 11 15:20:04 2023 +0800 idefics full finetune commit 11be13deb2c5e57b392d289670237714cdb5b012 Author: Bo Li <[email protected]> Date: Wed Oct 11 13:22:32 2023 +0800 also train vision encoder commit 3dfcf3e9a468897d1a251163d13a4a5de7542a64 Author: Li Bo <[email protected]> Date: Tue Oct 10 14:13:40 2023 +0000 fix video training commit b8a086bcbe43e5debd85fab2db11610df513558f Author: Li Bo <[email protected]> Date: Tue Oct 10 21:53:29 2023 +0800 Dev/train (#22) * Merge commit '2d29a417d9e96251be33edda0b0637647882c31b' * Conflicts: pipeline/mimicit_utils/mimicit_dataset.py * update mpt config * fix training padding * update fix * Squashed commit of the following: commit e4f1ec3b287c026a6212a88316d7341883195294 Author: Li Bo <[email protected]> Date: Tue Oct 10 13:47:47 2023 +0000 update output path commit 1a8e12bfa21697188eaa7a4ed6169223e0f92258 Author: Li Bo <[email protected]> Date: Tue Oct 10 12:23:02 2023 +0000 update naming rule …
…ity and remove unnecessary comments * feat(mimicit_dataset.py): Add support for the "idefics" model by using the AutoProcessor from HuggingFace library
commit 8d64138ed972e3195814d8cb94c0e976c5759dd6 Author: Li Bo <[email protected]> Date: Sun Nov 5 18:14:15 2023 +0000 updates commit 06600881a7cbf11b4f045e5e82b1484a03f60d4a Author: Li Bo <[email protected]> Date: Sun Nov 5 17:10:00 2023 +0000 updates
* fix(instruction_following.py): remove unnecessary whitespace * fix(train_utils.py): remove unnecessary whitespace
…in_dev Conflicts: shared_scripts/Otter_MPT7B_Train_Decoder.json
…lf.image_processor for consistency * refactor(mimicit_dataset.py): update patch_resize_transform to use self.image_processor instead of image_processor
…in_dev Conflicts: shared_scripts/Otter_MPT7B_Train_Decoder.json
…in_dev Conflicts:pipeline/mimicit_utils/mimicit_dataset.py
* feat(README.md): Add support for process.env.PORT environment variable * fix(docs/mimicit_format.md): Update example code for organizing multiple groups of datasets
* feat(README.md): improve pipeline for Pretrain, SFT, RLHF with current leading LMMs * feat(README.md): add models, training datasets, and benchmark interface details * feat(README.md): refactor code for organizing multiple groups of datasets with integrated yaml file
* docs(README.md): update Twitter follow badge link
* docs(README.md): comment out license and code style badges
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Before you open a pull-request, please check if a similar issue already exists or has been closed before.
When you open a pull-request, please be sure to include the following
dataset(mimic-it download, usage, etc.),demo(online demo),doc(readme, wiki, paper, video, etc.),evaluation(evaluation result, performance of Otter, etc.),model(model configuration, components, etc.),train(training configuration, process, code, etc.)Thank you for your contributions!