Benchmark

non-incremental/UFNIA/lahiri-cav09-storm-queries/serial_read_example_2_1_6_4.smt2 

Shuvendu K. Lahiri, Shaz Qadeer, Zvonimir Rakamaric, Static and Precise 
    Detection of Concurrency Errors in Systems Code Using SMT Solvers, in 
    Computer Aided Verification (CAV '09), Springer Verlag, February 2009
    <http://research.microsoft.com/apps/pubs/default.aspx?id=80360>
Benchmark
Size3441864
Compressed Size352881
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3441856
Compressed Size352888
Max. Term Depth1747
Asserts 19
Declared Functions669
Declared Constants10104
Declared Sorts 3
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true5711 not723 or107 and1837
=>29456 =20319 distinct2 forall2109
exists3 let1026 Int1081 +241
-158 *13 <197 <=195
>91 >=10

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 69.85440 —
Z3-SMT-COMP-2011 default unsat ✅ 31.45790 —
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2400.54000 2401.55000
CVC4 CVC4 f7118b2 default unsat ✅ 788.35500 787.45100
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 58.12140 58.11920
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2401.61000 2402.60000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1200.45000 1160.15000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1202.27000 1191.24000
Z3 z3 4.4.0 default unsat ✅ 67.66740 67.68070
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1119.85000 675.12500
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 160.40100 161.21400
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 136.39300 410.77200
Z3 z3-4.4.1 default unsat ✅ 64.33300 64.34990
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02200 405.37000
Vampire vampire4.2-smt vampire unsat ✅ 272.15600 1034.28000
Z3 z3-4.5.0 default unsat ✅ 49.06860 49.06740
SMT-COMP 2018 0.67 (1/3) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.09000 777.96000
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.07000 4763.55000
Z3 z3-4.7.1_default unsat ✅ 29.48290 29.48110
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 220.78900 876.41000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.10000 1802.64000
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 2263.03000 1634.48000
Par4 Par4-wrapped-sq_default unsat ✅ 81.95710 145.90000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.26552 3.31983
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.38873 3.32326
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.10000 9467.45000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 393.96600 1551.18000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 54.26560 54.25460
z3-4.7.1_default unsat ✅ 75.24610 75.23480
SMT-COMP 2020 0.50 (3/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 201.31100 795.82000
CVC4 CVC4-sq-final_default unknown ❌ 1200.47000 652.70600
Par4 Par4-wrapped-sq_default unsat ✅ 89.70980 154.02000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.29931 3.52040
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 391.67400 1508.87000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.02000 4748.12000
Z3 z3-4.8.8_default unsat ✅ 23.33030 23.32790
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.51000 658.40300
cvc5 cvc5-fixed_default unknown ❌ 1200.03000 768.89000
Par4 Par4-wrapped-sq_default unsat ✅ 47.27890 79.61000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 3.20676 9.49572
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.93927 4.87073
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.03000 4700.86000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 313.68200 1188.60000
Z3 z3-4.8.11_default unsat ✅ 26.18580 26.17720
SMT-COMP 2022 0.80 (1/5) CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 770.98000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.12000 699.63000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 6.92203 4.80005
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.06000 4779.49000
Z3 z3-4.8.17_default unsat ✅ 33.01090 33.01130
SMT-COMP 2023 1.00 (0/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.02000 613.70000
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.09000 603.99000
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.07000 4736.52000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.78704 4.91021
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.02000 4748.19000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 1053.91507 1053.25601
iProver iProver v3.9 unknown ❌ 1201.74322 4748.96308
SMTInterpol SMTInterpol unknown ❌ 1202.77082 1789.62564
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 1039.60817 1039.34841
iProver iProver v3.9.3 unknown ❌ 1201.77366 4744.33290
SMTInterpol SMTInterpol unknown ❌ 1201.84978 2184.72037
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.90530 4.09729