Benchmark

non-incremental/UFNIA/lahiri-cav09-storm-queries/serial_read_example_2_1_2_0.smt2 

Shuvendu K. Lahiri, Shaz Qadeer, Zvonimir Rakamaric, Static and Precise 
    Detection of Concurrency Errors in Systems Code Using SMT Solvers, in 
    Computer Aided Verification (CAV '09), Springer Verlag, February 2009
    <http://research.microsoft.com/apps/pubs/default.aspx?id=80360>
Benchmark
Size3568325
Compressed Size368757
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3568317
Compressed Size368766
Max. Term Depth1767
Asserts 19
Declared Functions669
Declared Constants10639
Declared Sorts 3
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true5719 not922 or107 and1837
=>30626 =21102 distinct2 forall2109
exists3 let1009 Int1081 +241
-158 *13 <337 <=335
>91 >=10

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 150.50200 —
Z3-SMT-COMP-2011 default unsat ✅ 67.24470 —
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 2400.66000 2401.65000
CVC4 CVC4 f7118b2 default unknown ❌ 2399.71000 2400.05000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 133.54800 133.57200
SMT-COMP 2015 0.67 (1/3) CVC3 CVC3 default unknown ❌ 2401.86000 2403.08000
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2402.09000 2396.16000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.02000 2386.18000
Z3 z3 4.4.0 default unsat ✅ 166.49500 166.55700
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 920.56800 666.13600
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 148.05400 148.79900
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 127.63900 402.69400
Z3 z3-4.4.1 default unsat ✅ 113.81400 113.88000
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.37500 415.46000
Vampire vampire4.2-smt vampire unsat ✅ 276.38100 1049.07000
Z3 z3-4.5.0 default unsat ✅ 172.65500 172.62600
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.03000 660.33000
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 395.15800 1559.35000
Z3 z3-4.7.1_default unsat ✅ 103.86100 103.85000
SMT-COMP 2019 0.50 (3/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 216.30600 859.13000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.03000 1674.60000
CVC4-SymBreak_03_06_2019-wrapped-sq_default unknown ❌ 2400.11000 1774.37000
Par4 Par4-wrapped-sq_default unsat ✅ 70.85030 102.62000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.40382 3.39944
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.35283 3.36918
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.05000 9465.94000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 384.29900 1508.60000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 84.22470 84.21490
z3-4.7.1_default unsat ✅ 68.77000 68.76740
SMT-COMP 2020 0.50 (3/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 222.20800 880.26000
CVC4 CVC4-sq-final_default unknown ❌ 1200.73000 719.31500
Par4 Par4-wrapped-sq_default unsat ✅ 76.04160 138.71000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.29625 3.38056
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 378.36300 1448.88000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.08000 4742.42000
Z3 z3-4.8.8_default unsat ✅ 60.54300 60.53680
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.11000 764.81000
cvc5 cvc5-fixed_default unknown ❌ 1200.10000 491.71000
Par4 Par4-wrapped-sq_default unsat ✅ 79.54380 138.90000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 5.01805 1.95489
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.75623 5.03889
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.03000 4721.92000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 319.11700 1210.08000
Z3 z3-4.8.11_default unsat ✅ 61.72260 61.70010
SMT-COMP 2023 1.00 (0/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.50000 722.11700
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 677.25000
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.09000 4733.35000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.91159 4.80202
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1199.43000 4800.36000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 1106.14793 1105.78265
iProver iProver v3.9 unknown ❌ 1201.77623 4755.26742
SMTInterpol SMTInterpol unknown ❌ 1202.72085 2101.74798
SMT-COMP 2025 1.00 (0/4) cvc5 cvc5 unknown ❌ 1201.79071 1201.46450
iProver iProver v3.9.3 unknown ❌ 1201.78942 4744.24130
SMTInterpol SMTInterpol unknown ❌ 1201.89339 2129.25618
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.89261 4.07428