Benchmark

non-incremental/UFNIA/lahiri-cav09-storm-queries/mqueue_example_2_2_8_0.smt2 

Shuvendu K. Lahiri, Shaz Qadeer, Zvonimir Rakamaric, Static and Precise 
    Detection of Concurrency Errors in Systems Code Using SMT Solvers, in 
    Computer Aided Verification (CAV '09), Springer Verlag, February 2009
    <http://research.microsoft.com/apps/pubs/default.aspx?id=80360>
Benchmark
Size1604972
Compressed Size153525
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1604964
Compressed Size153533
Max. Term Depth1310
Asserts 19
Declared Functions192
Declared Constants4637
Declared Sorts 3
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true5217 not494 or18 and1027
=>21394 =8469 distinct2 forall504
exists3 let719 Int266 +46
-42 *13 <60 <=57
>15 >=9

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2009 1.00 (0/1) CVC3 CVC3 2.0 unknown ❌ 900.00000 —
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 20.58560 —
Z3-SMT-COMP-2011 default unsat ✅ 12.64880 —
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2398.95000 2400.20000
CVC4 CVC4 f7118b2 default unsat ✅ 9.59959 9.59154
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 29.46160 29.46750
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2400.17000 2401.39000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 145.29500 145.30900
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 145.64000 145.62100
Z3 z3 4.4.0 default unsat ✅ 41.97790 41.99560
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 59.14740 52.59450
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 89.03750 89.81520
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 64.24650 250.59000
Z3 z3-4.4.1 default unsat ✅ 32.30160 32.32160
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 56.81940 51.67210
Vampire vampire4.2-smt vampire unsat ✅ 6.49724 21.21000
Z3 z3-4.5.0 default unsat ✅ 1.33424 1.33377
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 19.68000 19.67930
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.09000 4771.40000
Z3 z3-4.7.1_default unsat ✅ 10.98280 10.97950
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 154.10300 611.74000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 23.67160 23.64230
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 20.78520 20.78660
Par4 Par4-wrapped-sq_default unsat ✅ 17.03940 33.94000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.27964 3.42568
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.30521 3.44981
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 245.02900 943.41000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 2372.45000 9402.99000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 17.63030 17.63110
z3-4.7.1_default unsat ✅ 14.94610 14.94210
SMT-COMP 2020 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 144.09800 572.38000
CVC4 CVC4-sq-final_default unsat ✅ 426.08800 381.84200
Par4 Par4-wrapped-sq_default unsat ✅ 22.07130 44.01000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.70737 3.81128
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 38.11840 147.84000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.03000 4753.80000
Z3 z3-4.8.8_default unsat ✅ 10.01410 10.01270
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 17.16140 17.16060
cvc5 cvc5-fixed_default unsat ✅ 9.44791 9.44793
Par4 Par4-wrapped-sq_default unsat ✅ 14.22060 28.32000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 2.68929 7.49538
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 11.77600 5.03855
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 278.98200 1053.48000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 38.28270 148.75000
Z3 z3-4.8.11_default unsat ✅ 9.77025 9.77028
SMT-COMP 2022 0.40 (3/5) CVC4 CVC4-sq-final_default unsat ✅ 19.55750 19.55690
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 10.83460 10.83550
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.78915 4.77928
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 50.68080 196.62000
Z3 z3-4.8.17_default unsat ✅ 18.61640 18.61720
SMT-COMP 2023 0.25 (3/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 11.19040 11.18370
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 12.39630 12.39610
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 398.96500 1571.33000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.85259 4.83777
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 53.15260 207.19000
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 8.60544 8.50089
iProver iProver v3.9 unsat ✅ 321.70221 1261.42748
SMTInterpol SMTInterpol unknown ❌ 1202.25768 4400.21201
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 6.64937 6.51617
iProver iProver v3.9.3 unsat ✅ 278.23805 1087.41230
SMTInterpol SMTInterpol unknown ❌ 389.14985 1422.38076
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.92164 4.08352