Merge pull request #59 from hmorimitsu/rapidflow

Rapidflow
hmorimitsu · Mar 7, 2024 · af39517 · af39517
2 parents b7874ab + 91578a4
commit af39517
Show file tree

Hide file tree

Showing 74 changed files with 3,011 additions and 785 deletions.
diff --git a/README.md b/README.md
@@ -24,6 +24,18 @@ This is still under development, so some things may not work as intended. I plan
 
 ## What's new
 
+###  - v0.3.1
+
+- Added new models:
+  - CCMR [https://arxiv.org/abs/2311.02661](https://arxiv.org/abs/2311.02661)
+  - LLA-Flow [https://arxiv.org/abs/2304.08101](https://arxiv.org/abs/2304.08101)
+  - RAPIDFlow [https://hmorimitsu.com/publication/2024-icra-rapidflow/](https://hmorimitsu.com/publication/2024-icra-rapidflow/)
+- Enable FP16 in most models.
+  - Except the following models, since they have operations that cannot run in FP16: lcv_raft, matchflow, and separableflow
+- Add FP16 mode in infer, model_benchmark, and validate scripts
+- Create [plot_results.py](plot_results.py) script
+- Move resize operations to CUDA (thanks to coca-huang)
+
 ###  - v0.3.0
 
 - Added new models:
@@ -75,6 +87,7 @@ This is still under development, so some things may not work as intended. I plan
 - MS-RAFT+ [https://arxiv.org/abs/2210.16900](https://arxiv.org/abs/2210.16900)
 - PWCNet [https://arxiv.org/abs/1709.02371](https://arxiv.org/abs/1709.02371)
 - RAFT [https://arxiv.org/abs/2003.12039](https://arxiv.org/abs/2003.12039)
+- RAPIDFlow [https://hmorimitsu.com/publication/2024-icra-rapidflow/](https://hmorimitsu.com/publication/2024-icra-rapidflow/)
 - RPKNet [https://hmorimitsu.com/publication/2024-aaai-rpknet](https://hmorimitsu.com/publication/2024-aaai-rpknet)
 - ScopeFlow [https://arxiv.org/abs/2002.10770](https://arxiv.org/abs/2002.10770)
 - SCV [https://arxiv.org/abs/2104.02166](https://arxiv.org/abs/2104.02166)

diff --git a/docs/source/_static/kitti_2012_epe_outlier_all.html b/docs/source/_static/kitti_2012_epe_outlier_all.html
diff --git a/docs/source/_static/kitti_2012_epe_outlier_chairs.html b/docs/source/_static/kitti_2012_epe_outlier_chairs.html
diff --git a/docs/source/_static/kitti_2012_epe_outlier_kitti.html b/docs/source/_static/kitti_2012_epe_outlier_kitti.html
diff --git a/docs/source/_static/kitti_2012_epe_outlier_others.html b/docs/source/_static/kitti_2012_epe_outlier_others.html
diff --git a/docs/source/_static/kitti_2012_epe_outlier_sintel.html b/docs/source/_static/kitti_2012_epe_outlier_sintel.html
diff --git a/docs/source/_static/kitti_2012_epe_outlier_things.html b/docs/source/_static/kitti_2012_epe_outlier_things.html
diff --git a/docs/source/_static/kitti_2015_epe_outlier_all.html b/docs/source/_static/kitti_2015_epe_outlier_all.html
diff --git a/docs/source/_static/kitti_2015_epe_outlier_chairs.html b/docs/source/_static/kitti_2015_epe_outlier_chairs.html
diff --git a/docs/source/_static/kitti_2015_epe_outlier_kitti.html b/docs/source/_static/kitti_2015_epe_outlier_kitti.html
diff --git a/docs/source/_static/kitti_2015_epe_outlier_others.html b/docs/source/_static/kitti_2015_epe_outlier_others.html
diff --git a/docs/source/_static/kitti_2015_epe_outlier_sintel.html b/docs/source/_static/kitti_2015_epe_outlier_sintel.html
diff --git a/docs/source/_static/kitti_2015_epe_outlier_things.html b/docs/source/_static/kitti_2015_epe_outlier_things.html
diff --git a/docs/source/_static/plot-memory(gb)-fp32-sintel-final-occ-val_outlier.html b/docs/source/_static/plot-memory(gb)-fp32-sintel-final-occ-val_outlier.html
diff --git a/docs/source/_static/plot-params-flops.html b/docs/source/_static/plot-params-flops.html
diff --git a/docs/source/_static/plot-sintel-final-occ-val_epe-kitti-2015-val_outlier.html b/docs/source/_static/plot-sintel-final-occ-val_epe-kitti-2015-val_outlier.html
diff --git a/docs/source/_static/plot-time(ms)-fp32-sintel-final-occ-val_epe.html b/docs/source/_static/plot-time(ms)-fp32-sintel-final-occ-val_epe.html
diff --git a/docs/source/_static/sintel_clean_epe_outlier_all.html b/docs/source/_static/sintel_clean_epe_outlier_all.html
diff --git a/docs/source/_static/sintel_clean_epe_outlier_chairs.html b/docs/source/_static/sintel_clean_epe_outlier_chairs.html
diff --git a/docs/source/_static/sintel_clean_epe_outlier_kitti.html b/docs/source/_static/sintel_clean_epe_outlier_kitti.html
diff --git a/docs/source/_static/sintel_clean_epe_outlier_others.html b/docs/source/_static/sintel_clean_epe_outlier_others.html
diff --git a/docs/source/_static/sintel_clean_epe_outlier_sintel.html b/docs/source/_static/sintel_clean_epe_outlier_sintel.html
diff --git a/docs/source/_static/sintel_clean_epe_outlier_things.html b/docs/source/_static/sintel_clean_epe_outlier_things.html
diff --git a/docs/source/_static/sintel_final_epe_outlier_all.html b/docs/source/_static/sintel_final_epe_outlier_all.html
diff --git a/docs/source/_static/sintel_final_epe_outlier_chairs.html b/docs/source/_static/sintel_final_epe_outlier_chairs.html
diff --git a/docs/source/_static/sintel_final_epe_outlier_kitti.html b/docs/source/_static/sintel_final_epe_outlier_kitti.html
diff --git a/docs/source/_static/sintel_final_epe_outlier_others.html b/docs/source/_static/sintel_final_epe_outlier_others.html
diff --git a/docs/source/_static/sintel_final_epe_outlier_sintel.html b/docs/source/_static/sintel_final_epe_outlier_sintel.html
diff --git a/docs/source/_static/sintel_final_epe_outlier_things.html b/docs/source/_static/sintel_final_epe_outlier_things.html
diff --git a/docs/source/_static/speed_plot-all.html b/docs/source/_static/speed_plot-all.html
diff --git a/docs/source/index.rst b/docs/source/index.rst
@@ -66,9 +66,8 @@ use the its original code.
 
    results/accuracy_epe
    results/accuracy_epe_outlier
-   results/accuracy_plot
+   results/result_plots
    results/model_benchmark
-   results/speed_plot
 
 .. toctree::
    :maxdepth: 1

diff --git a/docs/source/models/checkpoint_list.csv b/docs/source/models/checkpoint_list.csv
@@ -109,6 +109,10 @@ raft-kitti-3a831a4b.ckpt,raft-kitti.pth,
 raft-sintel-fb44381e.ckpt,raft-sintel.pth,
 raft-things-802bbcfd.ckpt,raft-things.pth,
 raft_small-things-b7d9f997.ckpt,raft-small.pth,
+rapidflow-chairs-9c8c182a.ckpt,Original,PTLFlow
+rapidflow-kitti-2561329f.ckpt,Original,
+rapidflow-sintel-89a21262.ckpt,Original,
+rapidflow-things-0377c8fa.ckpt,Original,
 rpknet-chairs-a705b345.ckpt,Original,PTLFlow
 rpknet-kitti-39504eb4.ckpt,Original,
 rpknet-sintel-e7cc969e.ckpt,Original,

diff --git a/docs/source/models/models_list.rst b/docs/source/models/models_list.rst
@@ -299,6 +299,15 @@ RAFT
 
 - Model names: ``raft``, ``raft_small``
 
+RAPIDFlow
+---------
+
+`[source code] <https://github.com/hmorimitsu/ptlflow/tree/main/ptlflow/models/rapidflow>`__
+
+- Paper: **RAPIDFlow: Recurrent Adaptable Pyramids with Iterative Decoding for Efficient Optical Flow Estimation** - `https://hmorimitsu.com/publication/2024-icra-rapidflow/ <https://hmorimitsu.com/publication/2024-icra-rapidflow/>`_
+
+- Model names: ``rapidflow``, ``rapidflow_it1``, ``rapidflow_it2``, ``rapidflow_it3``, ``rapidflow_it6``, ``rapidflow_it12``
+
 RPKNet
 ------
 

diff --git a/docs/source/results/accuracy_plot.rst b/docs/source/results/accuracy_plot.rst