Challenge Description
Improve OpenCV performance on Milk-V Duo. The participant must port OpenCV to the Milk-V Duo platform, optimising its performance. The assessment rubrics will focus on both accuracy and performance: accuracy will be benchmarked using OpenCV’s regression testsuites (build/bin/opencv_test_*); performance will be assessed using OpenCV’s performance testsuites (build/bin/opencv_perf_*). The host will judge based on both the pass rates of regression testsuites and performance metrics, calculated in a pre-determined weighted score scale.
Rubrics
- Passes regression testsuites on all OpenCV modules (build/bin/opencv_test_*).
- Passes perfromance testsuites on all OpenCV modules (build/bin/opencv_perf_*).
- The host will judge based on both the pass rates of regression testsuites and performance metrics and assign scores to each submission based on a predetermined weighted scale. The highest scoring submission wins.
Submission
- Please submit your completed project at https://github.com/plctlab/rvspoc-s2309-opencv as a pull request.
- Please outline the software environment needed to run your submission in your pull request body.
- During the competition, all optimised artifacts may be submitted as the following:
- Binary files.
- Encrypted code (please send decryption details to rvspoc@cyberlimes.cn).
- Source code.
- After the results are announced, you will need to publish source code for all submissions.
- The committee will close pull request submissions after the challenge’s run time (on
February 16February 29, 2024) and commence assessment of submissions.
Assessment
- The assessment platform for this challenge is Duo (64MB model).
- Participants must submit:
- An SD card system image for the Duo board.
- Regression test pass rate and detailed testing results.
- Performance test pass rate and detailed testing results.
- Testing challenge and OpenCV runtime library, testing procedures and instructions, and scripts.
- The details of the challenges may change during the competition as we optimise and clarify the rubrics and instructions. Please keep an eye out for updates. The assessment committee reserves the right to final interpretation of all rubrics and instructions.
Notice on Intellectual Properties and Open Source Licenses
All challenge submissions must be open source and committed to a specified repository. The participant(s) (author) holds rights to their work. The host encourages contributing any changes made to the upstream.