Benchmark

non-incremental/UFNIA/lahiri-cav09-storm-queries/usbsamp_example_2_1_2_0.smt2 

Shuvendu K. Lahiri, Shaz Qadeer, Zvonimir Rakamaric, Static and Precise 
    Detection of Concurrency Errors in Systems Code Using SMT Solvers, in 
    Computer Aided Verification (CAV '09), Springer Verlag, February 2009
    <http://research.microsoft.com/apps/pubs/default.aspx?id=80360>
Benchmark
Size1933838
Compressed Size204130
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1933830
Compressed Size204139
Max. Term Depth1024
Asserts 19
Declared Functions281
Declared Constants6386
Declared Sorts 3
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3264 false1 not363 or68
and998 =>18446 =10720 distinct2
forall851 exists3 let500 Int448
+101 -65 *13 <140
<=146 >48 >=13

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 1.00 (0/1) CVC3 CVC3 2.0 unknown ❌ 1200.00000 —
CVC3 2.3 unknown ❌ 1200.10000 —
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 38.57610 —
Z3-SMT-COMP-2011 default unsat ✅ 23.43930 —
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2400.42000 2401.66000
CVC4 CVC4 f7118b2 default unsat ✅ 760.99400 760.99100
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 38.34340 38.35020
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2401.71000 2402.78000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1052.92000 1038.15000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1107.38000 1069.53000
Z3 z3 4.4.0 default unsat ✅ 45.03250 45.05110
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 964.94800 572.64500
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 889.36600 894.07800
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 64.62610 252.65100
Z3 z3-4.4.1 default unsat ✅ 33.74060 33.76170
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02300 342.11000
Vampire vampire4.2-smt vampire unsat ✅ 48.23430 187.34000
Z3 z3-4.5.0 default unsat ✅ 47.63600 47.62070
SMT-COMP 2018 0.67 (1/3) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.13000 635.53000
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.14000 4770.23000
Z3 z3-4.7.1_default unsat ✅ 19.12000 19.11140
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 170.57600 676.55000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.03000 1755.04000
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 2398.31000 1649.96000
Par4 Par4-wrapped-sq_default unsat ✅ 8.33932 16.61000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.32346 3.31284
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.19122 3.37827
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.09000 9502.45000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 2187.56000 8675.54000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 14.25580 14.25450
z3-4.7.1_default unsat ✅ 7.34687 7.34563
SMT-COMP 2020 0.50 (3/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 188.51200 748.30000
CVC4 CVC4-sq-final_default unknown ❌ 1200.06000 595.24000
Par4 Par4-wrapped-sq_default unsat ✅ 23.34400 46.58000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 35.20120 3.40742
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 305.21600 1180.52000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.03000 4752.47000
Z3 z3-4.8.8_default unsat ✅ 11.87170 11.87240
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.42000 659.63100
cvc5 cvc5-fixed_default unknown ❌ 1200.02000 29.99000
Par4 Par4-wrapped-sq_default unsat ✅ 23.37420 46.56000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 7.83527 13.04290
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.03652 5.62843
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 423.06200 1617.58000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 305.11500 1161.99000
Z3 z3-4.8.11_default unsat ✅ 17.44810 17.44750
SMT-COMP 2022 0.60 (2/5) CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 598.34000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.50000 660.59100
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.86579 4.73429
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 396.45700 1565.27000
Z3 z3-4.8.17_default unsat ✅ 15.98580 15.98570
SMT-COMP 2023 0.75 (1/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1204.37000 664.19700
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.04000 752.86000
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.10000 4731.04000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.85292 4.82615
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 383.81200 1513.81000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 1035.33970 1034.72507
iProver iProver v3.9 unknown ❌ 1201.74504 4713.47934
SMTInterpol SMTInterpol unknown ❌ 1202.71594 2356.35643
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 1017.60473 1017.37521
iProver iProver v3.9.3 unknown ❌ 1201.78357 4722.24590
SMTInterpol SMTInterpol unknown ❌ 1201.89408 2684.69497
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.94582 4.07329