From 6831c3930618424bb28852cdc57a6b3c50aec0fa Mon Sep 17 00:00:00 2001 From: kpkavin04 Date: Tue, 4 Aug 2026 14:26:55 +0800 Subject: [PATCH] docs: replace EvalAI links with Hugging Face challenge platforms --- python-sdk/nuscenes/eval/detection/README.md | 14 +++++--------- python-sdk/nuscenes/eval/lidarseg/README.md | 12 +++++------- python-sdk/nuscenes/eval/panoptic/README.md | 14 +++++++------- python-sdk/nuscenes/eval/prediction/README.md | 11 +++++------ python-sdk/nuscenes/eval/tracking/README.md | 11 +++++------ 5 files changed, 27 insertions(+), 35 deletions(-) diff --git a/python-sdk/nuscenes/eval/detection/README.md b/python-sdk/nuscenes/eval/detection/README.md index 7698edeb3..ccd79c14e 100644 --- a/python-sdk/nuscenes/eval/detection/README.md +++ b/python-sdk/nuscenes/eval/detection/README.md @@ -17,12 +17,12 @@ The goal of this task is to place a 3D bounding box around 10 different object c as well as estimating a set of attributes and the current velocity vector. ## Participation -The nuScenes detection [evaluation server](https://eval.ai/web/challenges/challenge-page/356/overview) is open all year round for submission. -To participate in the challenge, please create an account at [EvalAI](https://eval.ai/web/challenges/challenge-page/356/overview). +The nuScenes detection [evaluation server](https://huggingface.co/spaces/nuscenes/nuscenes-detection-challenge) is open all year round for submission. +To participate in the challenge, please create an account at [Hugging Face](https://huggingface.co/join). Then upload your zipped result file including all of the required [meta data](#results-format). After each challenge, the results will be exported to the nuScenes [leaderboard](https://www.nuscenes.org/object-detection) shown above. This is the only way to benchmark your method against the test dataset. -We require that all participants send the following information to nuScenes@motional.com after submitting their results on EvalAI: +We require that all participants send the following information to nuScenes@motional.com after submitting their results on Hugging Face: - Team name - Method name - Authors @@ -38,14 +38,13 @@ Additionally we organize a number of challenges at leading Computer Vision confe Users that submit their results during the challenge period are eligible for awards. Any user that cannot attend the workshop (direct or via a representative) will be excluded from the challenge, but will still be listed on the leaderboard. -Click [here](https://eval.ai/web/challenges/challenge-page/356/overview) for the **EvalAI detection evaluation server**. +Click [here](https://huggingface.co/spaces/nuscenes/nuscenes-detection-challenge) for the **Hugging Face detection evaluation server**. ### 6th AI Driving Olympics, ICRA 2021 The fourth nuScenes detection challenge will be held at [ICRA 2021](http://www.icra2021.org/) as part of [The AI Driving Olympics: Evaluating Progress in Robotics through Standardized and Reproducible Benchmarks](https://driving-olympics.ai/). Submissions will be accepted from April 1 to May 26, 2021. The prizes will be awarded to submissions that outperform the previous state-of-the-art in their respective tracks. Results and winners will be announced at [The AI Driving Olympics: Evaluating Progress in Robotics through Standardized and Reproducible Benchmarks](https://driving-olympics.ai/). -Note that this challenge uses the same [evaluation server](https://eval.ai/web/challenges/challenge-page/356/overview) as previous detection challenges. A summary of the results can be seen below. For details, please refer to the [detection leaderboard](https://www.nuscenes.org/object-detection). @@ -60,7 +59,6 @@ For details, please refer to the [detection leaderboard](https://www.nuscenes.or The third nuScenes detection challenge will be held at [NeurIPS 2020](https://nips.cc/Conferences/2020/). Submissions will be accepted from November 1 to December 8, 2020. Results and winners will be announced at the [5th AI Driving Olympics](https://driving-olympics.ai/) at NeurIPS 2020. -Note that this challenge uses the same [evaluation server](https://eval.ai/web/challenges/challenge-page/356/overview) as previous detection challenges. A summary of the results can be seen below. For details, please refer to the [detection leaderboard](https://www.nuscenes.org/object-detection). @@ -76,7 +74,6 @@ For details, please refer to the [detection leaderboard](https://www.nuscenes.or The second nuScenes detection challenge will be held at [ICRA 2020](https://www.icra2020.org/). The submission period will open April 1 and continue until May 28th, 2020. Results and winners will be announced at the [Workshop on Benchmarking Progress in Autonomous Driving](http://montrealrobotics.ca/driving-benchmarks/). -Note that the previous [evaluation server](https://eval.ai/web/challenges/challenge-page/356/overview) can still be used to benchmark your results after the challenge period. A summary of the results can be seen below. For details, please refer to the [detection leaderboard](https://www.nuscenes.org/object-detection). @@ -95,7 +92,6 @@ The first nuScenes detection challenge was held at CVPR 2019. Submission opened May 6 and closed June 12, 2019. Results and winners were announced at the Workshop on Autonomous Driving ([WAD](https://sites.google.com/view/wad2019)) at [CVPR 2019](http://cvpr2019.thecvf.com/). For more information see the [leaderboard](https://www.nuscenes.org/object-detection). -Note that the [evaluation server](https://eval.ai/web/challenges/challenge-page/356/overview) can still be used to benchmark your results. A summary of the results can be seen below. For details, please refer to the [detection leaderboard](https://www.nuscenes.org/object-detection). @@ -122,7 +118,7 @@ For details, please refer to the [detection leaderboard](https://www.nuscenes.or * Top leaderboard entries and their papers will be manually reviewed. * Each user or team can have at most one account *per year* on the evaluation server. Users that create multiple accounts to circumvent the rules will be excluded from the competition. * Each user or team can submit at most three results *per year*. These results must come from different models, rather than submitting results from the same model at different training epochs or with slightly different parameters. -* Faulty submissions that return an error on Eval AI do not count towards the submission limit. +* Faulty submissions that return an error on Hugging Face do not count towards the submission limit. * Any attempt to circumvent these rules will result in a permanent ban of the team or company from all nuScenes challenges. ## Results format diff --git a/python-sdk/nuscenes/eval/lidarseg/README.md b/python-sdk/nuscenes/eval/lidarseg/README.md index 22295b2ff..6887c6588 100644 --- a/python-sdk/nuscenes/eval/lidarseg/README.md +++ b/python-sdk/nuscenes/eval/lidarseg/README.md @@ -29,12 +29,12 @@ When using the dataset in your research, please cite [Panoptic nuScenes](https:/ ``` ## Participation -The nuScenes lidarseg segmentation [evaluation server](https://eval.ai/web/challenges/challenge-page/720/overview) is open all year round for submission. -To participate in the challenge, please create an account at [EvalAI](https://eval.ai). +The nuScenes lidarseg segmentation [evaluation server](https://huggingface.co/spaces/nuscenes/nuscenes-lidarseg-challenge) is open all year round for submission. +To participate in the challenge, please create an account at [Hugging Face](https://huggingface.co/join). Then upload your zipped result folder with the required [content](#results-format). After each challenge, the results will be exported to the nuScenes [leaderboard](https://www.nuscenes.org/lidar-segmentation). This is the only way to benchmark your method against the test dataset. -We require that all participants send the following information to nuScenes@motional.com after submitting their results on EvalAI: +We require that all participants send the following information to nuScenes@motional.com after submitting their results on Hugging Face: - Team name - Method name - Authors @@ -50,14 +50,13 @@ Additionally we organize a number of challenges at leading Computer Vision confe Users that submit their results during the challenge period are eligible for awards. Any user that cannot attend the workshop (direct or via a representative) will be excluded from the challenge, but will still be listed on the leaderboard. -Click [here](https://eval.ai/web/challenges/challenge-page/720/overview) for the **EvalAI lidar segmentation evaluation server**. +Click [here](https://huggingface.co/spaces/nuscenes/nuscenes-lidarseg-challenge) for the **Hugging Face lidar segmentation evaluation server**. ### 6th AI Driving Olympics, ICRA 2021 The second nuScenes lidar segmentation challenge will be held at [ICRA 2021](http://www.icra2021.org/) as part of [The AI Driving Olympics: Evaluating Progress in Robotics through Standardized and Reproducible Benchmarks](https://driving-olympics.ai/). Submissions will be accepted from April 1 to May 26, 2021. The prizes will be awarded to submissions that outperform the previous state-of-the-art in their respective tracks. Results and winners will be announced at [The AI Driving Olympics: Evaluating Progress in Robotics through Standardized and Reproducible Benchmarks](https://driving-olympics.ai/). -Note that this challenge uses the same [evaluation server](https://eval.ai/web/challenges/challenge-page/720/overview) as previous lidar segmentation challenges. A summary of the results can be seen below. For details, please refer to the [lidar segmentation leaderboard](https://www.nuscenes.org/lidar-segmentation). @@ -73,7 +72,6 @@ The first nuScenes lidar segmentation challenge will be held at [NeurIPS 2020](h Submissions will be accepted from November 1 to December 8, 2020. Results and winners will be announced at the [5th AI Driving Olympics](https://driving-olympics.ai/) at NeurIPS 2020. For more information see the [leaderboard](https://www.nuscenes.org/lidar-segmentation). -Note that the [evaluation server](https://eval.ai/web/challenges/challenge-page/720/overview) can still be used to benchmark your results. A summary of the results can be seen below. For details, please refer to the [lidar segmentation leaderboard](https://www.nuscenes.org/lidar-segmentation). @@ -97,7 +95,7 @@ For details, please refer to the [lidar segmentation leaderboard](https://www.nu * Top leaderboard entries and their papers will be manually reviewed. * Each user or team can have at most one account *per year* on the evaluation server. Users that create multiple accounts to circumvent the rules will be excluded from the competition. * Each user or team can submit at most three results *per year*. These results must come from different models, rather than submitting results from the same model at different training epochs or with slightly different parameters. -* Faulty submissions that return an error on Eval AI do not count towards the submission limit. +* Faulty submissions that return an error on Hugging Face do not count towards the submission limit. * Any attempt to circumvent these rules will result in a permanent ban of the team or company from all nuScenes challenges. ## Results format diff --git a/python-sdk/nuscenes/eval/panoptic/README.md b/python-sdk/nuscenes/eval/panoptic/README.md index add237e3b..4dbb11f8c 100644 --- a/python-sdk/nuscenes/eval/panoptic/README.md +++ b/python-sdk/nuscenes/eval/panoptic/README.md @@ -33,13 +33,13 @@ When using the dataset in your research, please cite [Panoptic nuScenes](https:/ ``` ## Participation -The Panoptic nuScenes challenge [evaluation server](https://eval.ai/web/challenges/challenge-page/1243/overview) is +The Panoptic nuScenes challenge [evaluation server](https://huggingface.co/spaces/nuscenes/nuscenes-panoptic-challenge) is open all year round for submission. Participants can choose to attend both panoptic segmentation and panoptic tracking tasks, or only the panoptic segmentation task. To participate in the challenge, please create an account at -[EvalAI](https://eval.ai). Then upload your zipped result folder with the required [content](#results-format). After +[Hugging Face](https://huggingface.co/join). Then upload your zipped result folder with the required [content](#results-format). After each challenge, the results will be exported to the [Panoptic nuScenes leaderboard](https://www.nuscenes.org/panoptic). This is the only way to benchmark your method against the test dataset. We require that all participants send the -following information to nuScenes@motional.com after submitting their results on EvalAI: +following information to nuScenes@motional.com after submitting their results on Hugging Face: - Team name - Method name - Authors @@ -56,13 +56,13 @@ round. Additionally we organize a number of challenges at leading Computer Visio submit their results during the challenge period are eligible for awards. Any user that cannot attend the workshop (direct or via a representative) will be excluded from the challenge, but will still be listed on the leaderboard. +Click [here](https://huggingface.co/spaces/nuscenes/nuscenes-panoptic-challenge) for the **Hugging Face panoptic evaluation server**. + ### 7th AI Driving Olympics, NeurIPS 2021 The first Panoptic nuScenes challenge will be held at [NeurIPS 2021](https://nips.cc/Conferences/2021/). Submissions will be accepted from 1 September 2021. **The submission deadline is 1 December 2021, 12:00pm, noon, UTC.** Results and winners will be announced at the [7th AI Driving Olympics](https://driving-olympics.ai/) at NeurIPS 2021. -For more information see the [leaderboard](https://www.nuscenes.org/panoptic). Note that the -[evaluation server](https://eval.ai/web/challenges/challenge-page/1243/overview) can still be used to benchmark your -results after the challenge. +For more information see the [leaderboard](https://www.nuscenes.org/panoptic). ## Submission rules @@ -76,7 +76,7 @@ listed below. accounts to circumvent the rules will be excluded from the competition. * Each user or team can submit at most three results *per year*. These results must come from different models, rather than submitting results from the same model at different training epochs or with slightly different parameters. -* Faulty submissions that return an error on Eval AI do not count towards the submission limit. +* Faulty submissions that return an error on Hugging Face do not count towards the submission limit. * Any attempt to circumvent these rules will result in a permanent ban of the team or company from all nuScenes challenges. diff --git a/python-sdk/nuscenes/eval/prediction/README.md b/python-sdk/nuscenes/eval/prediction/README.md index ccc273272..e134d1a8e 100644 --- a/python-sdk/nuscenes/eval/prediction/README.md +++ b/python-sdk/nuscenes/eval/prediction/README.md @@ -14,12 +14,12 @@ A trajectory is a sequence of x-y locations. For this challenge, the predictions 2 hertz. ## Participation -The nuScenes prediction [evaluation server](https://eval.ai/web/challenges/challenge-page/591/overview) is open all year round for submission. -To participate in the challenge, please create an account at [EvalAI](https://eval.ai/web/challenges/challenge-page/591/overview). +The nuScenes prediction [evaluation server](https://huggingface.co/spaces/nuscenes/nuscenes-prediction-challenge) is open all year round for submission. +To participate in the challenge, please create an account at [Hugging Face](https://huggingface.co/join). Then upload your zipped result file including all of the required [meta data](#results-format). After each challenge, the results will be exported to the nuScenes [leaderboard](https://www.nuscenes.org/prediction) shown above. This is the only way to benchmark your method against the test dataset. -We require that all participants send the following information to nuScenes@motional.com after submitting their results on EvalAI: +We require that all participants send the following information to nuScenes@motional.com after submitting their results on Hugging Face: - Team name - Method name - Authors @@ -34,14 +34,13 @@ To allow users to benchmark the performance of their method against the communit Additionally, we intend to organize a number of challenges at leading Computer Vision and Machine Learning conference workshops. Users that submit their results during the challenge period are eligible for awards. These awards may be different for each challenge. -Click [here](https://eval.ai/web/challenges/challenge-page/591/overview) for the **EvalAI prediction evaluation server**. +Click [here](https://huggingface.co/spaces/nuscenes/nuscenes-prediction-challenge) for the **Hugging Face prediction evaluation server**. ### 6th AI Driving Olympics, ICRA 2021 The second nuScenes prediction challenge will be held at [ICRA 2021](http://www.icra2021.org/) as part of [The AI Driving Olympics: Evaluating Progress in Robotics through Standardized and Reproducible Benchmarks](https://driving-olympics.ai/). Submissions will be accepted from April 1 to May 26, 2021. The prizes will be awarded to submissions that outperform the previous state-of-the-art in their respective tracks. Results and winners will be announced at [The AI Driving Olympics: Evaluating Progress in Robotics through Standardized and Reproducible Benchmarks](https://driving-olympics.ai/). -Note that this challenge uses the same [evaluation server](https://eval.ai/web/challenges/challenge-page/591/overview) as previous prediction challenges. A summary of the results can be seen below. For details, please refer to the [prediction leaderboard](https://www.nuscenes.org/prediction). @@ -84,7 +83,7 @@ from the training set called the `train_val` set. * Top leaderboard entries and their papers will be manually reviewed to ensure no cheating was done. * Each user or team can have at most one account *per year* on the evaluation server. Users that create multiple accounts to circumvent the rules will be excluded from the competition. * Each user or team can submit at most three results *per month*. These results must come from different models, rather than submitting results from the same model at different training epochs or with slightly different parameters. -* Faulty submissions that return an error on Eval AI do not count towards the submission limit. +* Faulty submissions that return an error on Hugging Face do not count towards the submission limit. * Any attempt to make more submissions than allowed will result in a permanent ban of the team or company from all nuScenes challenges. ## Results format diff --git a/python-sdk/nuscenes/eval/tracking/README.md b/python-sdk/nuscenes/eval/tracking/README.md index 307d85168..495343046 100644 --- a/python-sdk/nuscenes/eval/tracking/README.md +++ b/python-sdk/nuscenes/eval/tracking/README.md @@ -37,12 +37,12 @@ To evaluate the tracking results, use `evaluate.py` in the [eval folder](https:/ In `loaders.py` we provide some methods to organize the raw box data into tracks that may be helpful. ## Participation -The nuScenes tracking evaluation server is open all year round for submission. -To participate in the challenge, please create an account at [EvalAI](https://eval.ai/web/challenges/challenge-page/476/overview). +The nuScenes tracking [evaluation server](https://huggingface.co/spaces/nuscenes/nuscenes-tracking-challenge) is open all year round for submission. +To participate in the challenge, please create an account at [Hugging Face](https://huggingface.co/join). Then upload your zipped result file including all of the required [meta data](#results-format). The results will be exported to the nuScenes leaderboard shown above (coming soon). This is the only way to benchmark your method against the test dataset. -We require that all participants send the following information to nuScenes@motional.com after submitting their results on EvalAI: +We require that all participants send the following information to nuScenes@motional.com after submitting their results on Hugging Face: - Team name - Method name - Authors @@ -58,14 +58,13 @@ Additionally we organize a number of challenges at leading Computer Vision confe Users that submit their results during the challenge period are eligible for awards. Any user that cannot attend the workshop (direct or via a representative) will be excluded from the challenge, but will still be listed on the leaderboard. -Click [here](https://eval.ai/web/challenges/challenge-page/476/overview) for the **EvalAI tracking evaluation server**. +Click [here](https://huggingface.co/spaces/nuscenes/nuscenes-tracking-challenge) for the **Hugging Face tracking evaluation server**. ### 6th AI Driving Olympics, ICRA 2021 The second nuScenes tracking challenge will be held at [ICRA 2021](http://www.icra2021.org/) as part of [The AI Driving Olympics: Evaluating Progress in Robotics through Standardized and Reproducible Benchmarks](https://driving-olympics.ai/). Submissions will be accepted from April 1 to May 26, 2021. The prizes will be awarded to submissions that outperform the previous state-of-the-art in their respective tracks. Results and winners will be announced at [The AI Driving Olympics: Evaluating Progress in Robotics through Standardized and Reproducible Benchmarks](https://driving-olympics.ai/). -Note that this challenge uses the same [evaluation server](https://eval.ai/web/challenges/challenge-page/476/overview) as previous tracking challenges. A summary of the results can be seen below. For details, please refer to the [tracking leaderboard](https://www.nuscenes.org/tracking). @@ -110,7 +109,7 @@ For details, please refer to the [tracking leaderboard](https://www.nuscenes.org * Top leaderboard entries and their papers will be manually reviewed. * Each user or team can have at most one account *per year* on the evaluation server. Users that create multiple accounts to circumvent the rules will be excluded from the competition. * Each user or team can submit at most three results *per year*. These results must come from different models, rather than submitting results from the same model at different training epochs or with slightly different parameters. -* Faulty submissions that return an error on Eval AI do not count towards the submission limit. +* Faulty submissions that return an error on Hugging Face do not count towards the submission limit. * Any attempt to circumvent these rules will result in a permanent ban of the team or company from all nuScenes challenges. ## Results format