MétaCan
Menu
← Back to cohort
Record W6949142879 · doi:10.5281/zenodo.12752245

Trackerless 3D Freehand Ultrasound Reconstruction Challenge 2024 - Validation Dataset

2024· dataset· en· W6949142879 on OpenAlexaboutno aff

Bibliographic record

VenueZenodo (CERN European Organization for Nuclear Research) · 2024
Typedataset
Languageen
FieldBiochemistry, Genetics and Molecular Biology
TopicBioinformatics and Genomic Networks
Canadian institutionsnot available
Fundersnot available
KeywordsOrientation (vector space)Code (set theory)Set (abstract data type)Frame (networking)Test setSpeckle patternLine (geometry)Data set

Abstract

fetched live from OpenAlex

This Challenge will be an open-ended challenge, and we welcome your submission. Please register your team via this ⁠form. You can submit the algorithm via this form for TUS-REC2024 Challenge, and we will test your submitted docker on the test set. We are organising TUS-REC2025 at MICCAI2025. More information is available on the TUS-REC2025 challenge website and Baseline code repo. This is the validation dataset. The training dataset is available at Part1, Part2, and Part3. Acquisition devices and config: The 2D US images were acquired using an Ultrasonix machine (BK, Europe) with a curvilinear probe (4DC7-3/40). The associated position information of each frame was recorded by an optical tracker (NDI Polaris Vicra, Northern Digital Inc., Canada). The acquired US frames were recorded at 20 fps, with an image size of 480×640, without speckle reduction. The frequency was set at 6MHz with a dynamic range of 83 dB, an overall gain of 48% and a depth of 9 cm. Scanning protocol: Both left and right forearms of volunteers were scanned. For each forearm, the US probe moves in three different trajectories (straight line shape, "C" shape, and "S" shape), in a distal-to-proximal direction followed by a proximal-to-distal direction, with the US plane perpendicular of and parallel to the scanning direction. The validation dataset contains 72 scans in total, 24 scans associated with each subject. For detailed information please refer to the Challenge website. Baseline code is also provided, which can be found at this repo. Dataset structure: Folder frames: contains three folders (one subject per folder), each with 24 scans. Each .h5 file corresponds to one scan, storing image of each frame within this scan. Key-value pair and name of each .h5 file are explained below. “frames” - All frames in the scan; with a shape of [N,H,W], where N refers to the number of frames in the scan, H and W denote the height and width of a frame. Notations in the name of each .h5 file: “RH”: right arm; “LH”: left arm; “Per”: perpendicular; “Par”: parallel; “L”: straight line shape; “C”: C shape; “S”: S shape; “DtP”: distal-to-proximal direction; “PtD”: proximal-to-distal direction; For example, “RH_Per_L_DtP.h5” denotes a scan on the right forearm, with ultrasound probe perpendicular of the forearm sweeping along straight line, in distal-to-proximal direction. Folder transfs: contains three folders (one subject per folder), each with 24 scans. Each .h5 file corresponds to one scan, storing transformation of each frame within this scan. Key-value pair and name of each .h5 file are explained below. “tforms” - All transformations in the scan; with a shape of [N,4,4], where N is the number of frames in the scan, and the transformation matrix denotes the transformation from tracker tool space to camera space. Notations in the name of each .h5 file is the same as in folder frames. Folder landmark: contains three .h5 files. Each corresponds to one subject, storing coordinates of landmarks for 24 scans of this subject. For each scan, the coordinates are stored in numpy array with a shape of [20,3]. The first column is the index of frame; the second and third columns denote the coordinates of landmarks in the image coordinate system. calib_matrix.csv: The calibration matrix was obtained using a pinhead-based method. The "scaling_from_pixel_to_mm" and "spatial_calibration_from_image_coordinate_system_to_tracking_tool_coordinate_system" are provided in the “calib_matrix.csv”. dataset_keys.h5: stores the paths to all the scans of the data set. Keys in “dataset_keys.h5” denotes all the available scans in validation set, in a format of “sub%03d__%s” where %03d denotes folder name, and %s denotes the scan name. For example, “sub050__LH_Par_C_DtP” means the scan in folder “050”, with file name of “LH_Par_C_DtP.h5” Data Usage Policy: The training and validation data provided may be utilized within the research scope of this challenge and in subsequent research-related publications. However, commercial use of the training and validation data is prohibited. In cases where the intended use is ambiguous, participants accessing the data are requested to abstain from further distribution or use outside the scope of this challenge. Please cite our challenge paper if you use our dataset in your publication: Challenge paper: Qi Li et al. "TUS-REC2024: A Challenge to Reconstruct 3D Freehand Ultrasound Without External Tracker." arXiv preprint arXiv:2506.21765 (2025). Additional relevant publications may also be cited as appropriate (optional): Optional articles: Qi Li, Ziyi Shen, Qianye Yang, Dean C. Barratt, Matthew J. Clarkson, Tom Vercauteren, and Yipeng Hu. "Nonrigid Reconstruction of Freehand Ultrasound without a Tracker." In International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 689-699. Cham: Springer Nature Switzerland, 2024. doi: 10.1007/978-3-031-72083-3_64. Qi Li, Ziyi Shen, Qian Li, Dean C. Barratt, Thomas Dowrick, Matthew J. Clarkson, Tom Vercauteren, and Yipeng Hu. "Long-term Dependency for 3D Reconstruction of Freehand Ultrasound Without External Tracker." IEEE Transactions on Biomedical Engineering, vol. 71, no. 3, pp. 1033-1042, 2024. doi: 10.1109/TBME.2023.3325551. Qi Li, Ziyi Shen, Qian Li, Dean C. Barratt, Thomas Dowrick, Matthew J. Clarkson, Tom Vercauteren, and Yipeng Hu. "Trackerless freehand ultrasound with sequence modelling and auxiliary transformation over past and future frames." In 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI), pp. 1-5. IEEE, 2023. doi: 10.1109/ISBI53787.2023.10230773. Qi Li, Ziyi Shen, Qian Li, Dean C. Barratt, Thomas Dowrick, Matthew J. Clarkson, Tom Vercauteren, and Yipeng Hu. "Privileged Anatomical and Protocol Discrimination in Trackerless 3D Ultrasound Reconstruction." In International Workshop on Advances in Simplifying Medical Ultrasound, pp. 142-151. Cham: Springer Nature Switzerland, 2023. doi: https://doi.org/10.1007/978-3-031-44521-7_14.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.004
metaresearch head score (Gemma)0.009
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Dataset · Consensus signal: Dataset
Teacher disagreement score0.044
Threshold uncertainty score0.146

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0040.009
Meta-epidemiology (narrow)0.0060.001
Meta-epidemiology (broad)0.0040.004
Bibliometrics0.0020.002
Science and technology studies0.0010.001
Scholarly communication0.0030.002
Open science0.0070.005
Research integrity0.0050.004
Insufficient payload (model declined to judge)0.0440.057

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.021
GPT teacher head0.246
Teacher spread0.225 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreDataset

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2024
Admission routes1
Has abstractyes

Explore more

Same venueZenodo (CERN European Organization for Nuclear Research)→Same topicBioinformatics and Genomic Networks→French-language works237,207→