Benchmark

non-incremental/UFNIA/lahiri-cav09-storm-queries/serial_write_example_2_2_2_3.smt2

Shuvendu K. Lahiri, Shaz Qadeer, Zvonimir Rakamaric, Static and Precise 
    Detection of Concurrency Errors in Systems Code Using SMT Solvers, in 
    Computer Aided Verification (CAV '09), Springer Verlag, February 2009
    <http://research.microsoft.com/apps/pubs/default.aspx?id=80360>
Benchmark
Size3553277
Compressed Size367044
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3553269
Compressed Size367032
Max. Term Depth1763
Asserts 19
Declared Functions669
Declared Constants10584
Declared Sorts 3
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true5718 not906 or107 and1841
=>30609 =21002 distinct2 forall2109
exists3 let1014 Int1081 +241
-158 *13 <335 <=333
>91 >=10

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2009 1.00 (0/1) CVC3 CVC3 2.0 unknown ❌ 900.00000
SMT-COMP 2010 1.00 (0/1) CVC3 CVC3 2.0 unknown ❌ 1200.00000
CVC3 2.3 unknown ❌ 1200.10000
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 190.58800
Z3-SMT-COMP-2011 default unsat ✅ 74.05350
SMT-COMP 2014 0.67 (1/3) CVC3 CVC3 default unknown ❌ 2400.62000 2401.82000
CVC4 CVC4 f7118b2 default unknown ❌ 2400.01000 2399.62000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 146.27200 146.27100
SMT-COMP 2015 0.67 (1/3) CVC3 CVC3 default unknown ❌ 2401.79000 2402.79000
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2386.89000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2336.19000
Z3 z3 4.4.0 default unsat ✅ 121.21100 121.26200
SMT-COMP 2016 0.33 (2/3) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.09000 1712.93000
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 137.52700 138.34500
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 119.55300 402.09600
Z3 z3-4.4.1 default unsat ✅ 127.14600 127.22200
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.06200 323.73000
Vampire vampire4.2-smt vampire unsat ✅ 273.13400 1074.88000
Z3 z3-4.5.0 default unsat ✅ 187.89300 187.86700
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.09000 591.83000
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 376.24900 1485.30000
Z3 z3-4.7.1_default unsat ✅ 91.39060 91.39010
SMT-COMP 2020 0.50 (3/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 199.38200 760.65000
CVC4 CVC4-sq-final_default unknown ❌ 1201.49000 556.18100
Par4 Par4-wrapped-sq_default unsat ✅ 84.65390 148.95000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.41257 3.51706
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 323.28900 1230.66000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 356.01000 1399.12000
Z3 z3-4.8.8_default unsat ✅ 66.45540 66.43660
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.11000 679.54000
cvc5 cvc5-fixed_default unknown ❌ 1200.03000 194.50000
Par4 Par4-wrapped-sq_default unsat ✅ 118.24000 190.63000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1.77847 4.48507
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 26.12430 5.23898
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.03000 4707.55000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 370.93600 1416.49000
Z3 z3-4.8.11_default unsat ✅ 58.40460 58.40170