Benchmark

non-incremental/QF_LIA/wisa/wisa5.smt2 

These benchmarks are formulas in quantifier-free Presburger arithmetic.  They
have been generated in software verification problems encountered by Vinod
Ganapathy and Somesh Jha in the Wisconsin Safety Analyzer (WiSA) project.
Please acknowledge the WiSA and UCLID projects in publications reporting
results on these benchmarks.  Thanks!

Sanjit Seshia, Feb. 2004

Relevant links:
* WiSA project: http://www.cs.wisc.edu/wisa
* UCLID project: http://www.cs.cmu.edu/~uclid

This benchmark was automatically translated into SMT-LIB format from
CVC format using CVC Lite
Benchmark
Size48273
Compressed Size6004
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2005-07-12
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 48265
Compressed Size6011
Max. Term Depth742
Asserts 1
Declared Functions0
Declared Constants83
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not391 or968 and872 =1356
let28 +323 -6 *2
<5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2005 1.00 (0/9) ARIO Ario unknown ❌ — —
CVC CVC unknown ❌ — —
CVC Lite CVC Lite unknown ❌ — —
HTP HTP unknown ❌ — —
MathSAT MathSat unknown ❌ — —
Sammy Sammy unknown ❌ — —
SBT SBT unknown ❌ — —
SVC SVC unknown ❌ — —
Yices Yices unknown ❌ — —
SMT-COMP 2006 0.88 (1/8) ARIO Ario 1.2 timeout ✅ 1207.90000 —
CVC3 CVC3 unknown ❌ 371.30000 —
ExtSAT ExtSAT 1.1 unknown ❌ 0.10000 —
HTP HTP timeout ✅ 1208.10000 —
MathSAT MathSAT 3.4 timeout ✅ 1208.10000 —
Yices Yices 1.0 unsat ✅ 2.60000 —
Yices 0.1 (2005 winner) timeout ✅ 1208.20000 —
SMT-COMP 2007 0.20 (4/5) Barcelogic Barcelogic 1.2 unsat ✅ 102.30000 —
CVC3 CVC3 1.2 unknown ❌ 1801.00000 —
MathSAT MathSAT 4.0 unsat ✅ 25.60000 —
Yices Yices 1.0 unsat ✅ 2.00000 —
Yices 1.0.10 unsat ✅ 2.10000 —
Z3 Z3 0.1 unsat ✅ 14.90000 —
SMT Evaluation 2013 0.33 (4/6) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.45582 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.00475 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 14.60010 —
MathSAT5-SMT-COMP-2010 default unsat ✅ 11.47010 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 15.14760 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 14.19240 —
test_pmathsat-SMT-COMP-2010 default unsat ✅ 9.35551 —
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 11.47400 —
SMTInterpol-SMT-COMP-2011 default unsat ✅ 7.26255 —
SMTInterpol-SMT-COMP-2012 default unsat ✅ 7.33822 —
veriT veriT-SMT-EVAL-2013 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.05826 —
Z3-SMT-COMP-2011 default unsat ✅ 1.13244 —
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 3.96471 3.95540
MathSAT MathSAT-5.2.12-Main default unsat ✅ 21.85340 21.84770
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 17.70020 24.34130
veriT veriT-smtcomp2014 default unsat ✅ 1.54297 1.53877
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.84678 0.83787
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 1.22097 1.21981
SMT-COMP 2015 0.14 (6/7) CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.54335 3.54246
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.54025 3.53846
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 16.30340 16.31050
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 16.17530 23.24950
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.84000
veriT veriT default unsat ✅ 1.69868 1.69874
Yices2 Yices default unsat ✅ 1.37059 1.36979
Z3 z3 4.4.0 default unsat ✅ 1.20267 1.20282
SMT-COMP 2016 0.12 (7/8) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.21739 3.21962
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 12.19370 12.20080
ProB ProB competition unknown ❌ 2400.02000 2401.46000
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 15.89450 28.40020
SMT-RAT SMT-RAT default unsat ✅ 1333.61000 1334.32000
veriT veriT-dev default unsat ✅ 67.44570 67.48460
Yices2 Yices-2.4.2 default unsat ✅ 1.74973 1.75072
Z3 z3-4.4.1 default unsat ✅ 1.12982 1.13165
SMT-COMP 2017 0.29 (5/7) CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.56854 4.56756
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 125.76100 125.75600
SMTInterpol SMTInterpol default unsat ✅ 26.02670 36.24110
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.05700 600.07200
veriT veriT-2017-06-17 default unknown ❌ 600.02000 599.98800
Yices2 Yices2-Main default unsat ✅ 1.60308 1.60258
Z3 z3-4.5.0 default unsat ✅ 1.02578 1.02409
SMT-COMP 2018 0.12 (7/8) Ctrl-Ergo Ctrl-Ergo-SMTComp-2018_default unsat ✅ 984.18800 3915.81000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.68420 3.68413
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 101.95100 101.94500
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 11.37840 19.29600
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.05000 1200.05000
veriT veriT_default unsat ✅ 3.25713 6.48699
Yices2 Yices 2.6.0_default unsat ✅ 0.81144 0.81140
Z3 z3-4.7.1_default unsat ✅ 1.04862 1.04845
SMT-COMP 2022 0.17 (5/6) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.08516 4.08543
MathSAT MathSAT-5.6.8_default unsat ✅ 60.21580 60.21930
Par4 Par4-wrapped-sq_default unsat ✅ 1.05170 3.04000
veriT veriT_default unknown ❌ 1200.09000 1200.01000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 1.45307 1.45300
Z3 z3-4.8.17_default unsat ✅ 2.79452 2.79613
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 2.88690 2.78711
OpenSMT OpenSMT unsat ✅ 0.83267 0.73302
SMTInterpol SMTInterpol unsat ✅ 58.35796 103.10468
Yices2 Yices2 unsat ✅ 1.57912 1.47944
Z3alpha Z3-alpha unsat ✅ 1.87641 1.77655