FSMBench

university

AI & ML interests

Evaluating and Benchmarking Large Multimodal Models

Recent Activity

taesiri submitted a paper about 11 hours ago

Editable Visual Design

taesiri submitted a paper about 11 hours ago

Environment Evolution for Terminal Agents

taesiri submitted a paper about 11 hours ago

Principia: Relational Physics Tests for Video Models

View all activity

spaces 3

FSMBenchLeaderboard

Heatmaps

Display heatmaps for model performance comparisons

Something

models 0

None public yet

datasets 13

FSMBench/fsmbench_reborn_subset_864

Viewer • Updated May 13, 2024 • 864 • 22

FSMBench/fsmbench_reborn_12k

Viewer • Updated May 13, 2024 • 12.8k • 18

FSMBench/simple_fsm_vision_qa

Viewer • Updated May 6, 2024 • 1.92k • 17

FSMBench/fsmbench_what_will_be_the_state_12K_with_output_instruction

Viewer • Updated May 5, 2024 • 12.8k • 23

FSMBench/fsmbench_intersection_set_2

Viewer • Updated Apr 21, 2024 • 1.58k • 16

FSMBench/fsmbench_what_will_be_the_state_12K_oneshot

Viewer • Updated Apr 16, 2024 • 12.8k • 9

FSMBench/fsmbench_intersection_set_1

Viewer • Updated Apr 16, 2024 • 500 • 29

FSMBench/fsmbench_what_will_be_the_state_12K_think_step_by_step_image

Viewer • Updated Apr 13, 2024 • 12.8k • 13

FSMBench/fsmbench_what_will_be_the_state_12K_image

Viewer • Updated Mar 23, 2024 • 12.8k • 11

FSMBench/fsmbench_what_will_be_the_state_12K_think_step_by_step

Viewer • Updated Mar 18, 2024 • 12.8k • 22

View 13 datasets