Benchmark

non-incremental/UFNIA/lahiri-cav09-storm-queries/serial_write_example_1_2.smt2

Shuvendu K. Lahiri, Shaz Qadeer, Zvonimir Rakamaric, Static and Precise 
    Detection of Concurrency Errors in Systems Code Using SMT Solvers, in 
    Computer Aided Verification (CAV '09), Springer Verlag, February 2009
    <http://research.microsoft.com/apps/pubs/default.aspx?id=80360>
Benchmark
Size3303994
Compressed Size329203
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3303986
Compressed Size329211
Max. Term Depth1183
Asserts 19
Declared Functions669
Declared Constants9769
Declared Sorts 3
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2992 not453 or107 and1305
=>24526 =18751 distinct2 forall2109
exists3 let399 Int1081 +241
-158 *13 <234 <=232
>91 >=10

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2009 1.00 (0/1) CVC3 CVC3 2.0 unknown ❌ 900.00000
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 20.84670
Z3-SMT-COMP-2011 default unsat ✅ 30.04280
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2400.35000 2401.56000
CVC4 CVC4 f7118b2 default unsat ✅ 752.40300 752.34700
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 12.27320 12.27010
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2401.62000 2402.62000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1067.01000 1056.32000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1107.33000 1089.15000
Z3 z3 4.4.0 default unsat ✅ 9.54874 9.55255
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1036.56000 612.18000
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 119.35700 119.92700
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 96.68580 360.76000
Z3 z3-4.4.1 default unsat ✅ 45.37450 45.40530
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.03400 360.91000
Vampire vampire4.2-smt vampire unsat ✅ 267.47800 1020.66000
Z3 z3-4.5.0 default unsat ✅ 13.35950 13.35950
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.03000 640.71000
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 338.75900 1340.88000
Z3 z3-4.7.1_default unsat ✅ 7.06337 7.06324
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 220.05300 661.00000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.03000 1685.31000
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 2242.20000 1624.38000
Par4 Par4-wrapped-sq_default unsat ✅ 6.72983 13.33000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.76108 3.68022
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.37774 3.38198
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.05000 9584.55000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 2380.20000 9460.79000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 10.82830 10.82540
z3-4.7.1_default unsat ✅ 6.00092 6.00082
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 630.74000
cvc5 cvc5-fixed_default unknown ❌ 1200.09000 391.09000
Par4 Par4-wrapped-sq_default unsat ✅ 10.89510 21.73000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 3.14312 9.27420
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.89008 4.95899
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.04000 4706.89000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 366.96600 1405.55000
Z3 z3-4.8.11_default unsat ✅ 8.56790 8.56578
SMT-COMP 2022 0.80 (1/5) CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 694.59000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.06000 656.65000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.83740 4.71119
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.02000 4754.73000
Z3 z3-4.8.17_default unsat ✅ 9.32006 9.31925
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 1025.61723 1025.49605
iProver iProver v3.9 unknown ❌ 1201.74714 4733.87835
SMTInterpol SMTInterpol unknown ❌ 1202.71892 1747.79426
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 1024.39564 1024.17192
iProver iProver v3.9.3 unknown ❌ 1201.78978 4736.20892
SMTInterpol SMTInterpol unknown ❌ 1201.88790 2282.16511
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.92976 4.14630