Benchmark

non-incremental/UFNIA/lahiri-cav09-storm-queries/usbsamp_example_2_1_8_4.smt2 

Shuvendu K. Lahiri, Shaz Qadeer, Zvonimir Rakamaric, Static and Precise 
    Detection of Concurrency Errors in Systems Code Using SMT Solvers, in 
    Computer Aided Verification (CAV '09), Springer Verlag, February 2009
    <http://research.microsoft.com/apps/pubs/default.aspx?id=80360>
Benchmark
Size1856841
Compressed Size192555
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1856833
Compressed Size192562
Max. Term Depth981
Asserts 19
Declared Functions281
Declared Constants6079
Declared Sorts 3
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3212 false1 not301 or68
and998 =>17598 =10245 distinct2
forall851 exists3 let486 Int448
+101 -65 *13 <87
<=93 >48 >=13

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 7.74372 —
Z3-SMT-COMP-2011 default unsat ✅ 8.08266 —
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2400.60000 2401.61000
CVC4 CVC4 f7118b2 default unsat ✅ 732.86400 732.66500
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 17.14370 17.14240
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2401.81000 2402.84000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1056.67000 1023.57000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1057.31000 1052.20000
Z3 z3 4.4.0 default unsat ✅ 15.76490 15.76460
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 899.94500 556.90700
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 738.28100 742.69900
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 62.48540 244.18000
Z3 z3-4.4.1 default unsat ✅ 17.78820 17.79950
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.04600 356.98000
Vampire vampire4.2-smt vampire unsat ✅ 49.27720 191.89000
Z3 z3-4.5.0 default unsat ✅ 23.78440 23.78250
SMT-COMP 2018 0.67 (1/3) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.06000 619.71000
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.09000 4770.89000
Z3 z3-4.7.1_default unsat ✅ 6.51458 6.51398
SMT-COMP 2019 0.50 (3/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 177.16200 703.12000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.04000 1452.54000
CVC4-SymBreak_03_06_2019-wrapped-sq_default unknown ❌ 2400.11000 1618.96000
Par4 Par4-wrapped-sq_default unsat ✅ 5.35319 10.60000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.37440 3.34911
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 59.29590 3.44034
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.10000 9519.75000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 2194.13000 8700.01000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 8.48595 8.48540
z3-4.7.1_default unsat ✅ 4.75996 4.76004
SMT-COMP 2020 0.50 (3/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 165.65900 656.61000
CVC4 CVC4-sq-final_default unknown ❌ 1200.29000 592.48700
Par4 Par4-wrapped-sq_default unsat ✅ 5.82037 11.59000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.43843 3.53579
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 308.12900 1187.01000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.07000 4755.48000
Z3 z3-4.8.8_default unsat ✅ 10.81850 10.81140
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.10000 654.82000
cvc5 cvc5-fixed_default unknown ❌ 1200.07000 194.83000
Par4 Par4-wrapped-sq_default unsat ✅ 6.18124 12.14000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 2.15149 6.16042
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.93783 4.85810
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 427.12400 1640.13000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 287.36500 1097.31000
Z3 z3-4.8.11_default unsat ✅ 6.88350 6.88278
SMT-COMP 2022 0.60 (2/5) CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 704.64000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.09000 626.77000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.90068 4.68506
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 406.76800 1604.60000
Z3 z3-4.8.17_default unsat ✅ 8.79514 8.79466
SMT-COMP 2023 0.75 (1/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.11000 695.94000
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.03000 779.93000
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.04000 4729.97000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.93116 4.88083
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 382.65300 1517.12000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 1021.17872 1021.01979
iProver iProver v3.9 unknown ❌ 1201.74572 4719.51080
SMTInterpol SMTInterpol unknown ❌ 1202.74359 2267.49645