Benchmark

non-incremental/QF_BV/sage/app7/bench_2142.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size848793
Compressed Size75164
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 848785
Compressed Size75174
Max. Term Depth3231
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1357 and1
=1858 let3174 extract1139 bvand7363
bvor4692 bvxor1257 bvadd8691 bvmul1
bvsub2833 bvult410 bvule394 bvslt185
bvsle95 bvshl2677 bvashr4399 zero_extend860

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.11723 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.15373 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.15327 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.15970 —
abziz_portfolio_2012_solvers default unsat ✅ 0.15283 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.15987 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.15447 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.19103 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.16278 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 1.85022 —
CVC3-SMT-COMP-2011 default unsat ✅ 1.65325 —
CVC3-SMT-COMP-2012 default unsat ✅ 1.66624 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.76146 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.29698 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.26522 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.24779 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.33189 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.31802 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.24010 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.36793 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.45866 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.32307 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.12442 —
STP2-SMT-COMP-2012 default unsat ✅ 0.11718 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.12196 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.16981 —
Z3-SMT-COMP-2011 default unsat ✅ 0.14848 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.20968 0.20897
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.19834 1.98370
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.20265 1.99370
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.19223 0.19097
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.65000
STP stp-cryptominisat4 default unsat ✅ 0.11203 0.11098
stp-cmsat4-v15 default unsat ✅ 0.11161 0.11098
stp-cmsat4-mt-v15 default unsat ✅ 0.11161 0.11098
stp-minisat-v15 default unsat ✅ 0.11192 0.11098
Yices2 Yices default unsat ✅ 0.05533 0.05399
Z3 z3 4.4.0 default unsat ✅ 0.17849 0.17897
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.48609 0.48582
ABC_glucose glucose unsat ✅ 0.47777 0.47807
Boolector Boolector boolector unsat ✅ 0.23969 0.23980
Boolector preprop boolector unsat ✅ 0.23103 0.23115
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.17189 1.94619
MapleSTP MapleSTP default unsat ✅ 0.10601 0.10625
MapleSTP-mt default unsat ✅ 0.10737 0.10740
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.17242 0.17349
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.13897 0.13902
Q3B Q3B default unsat ✅ 0.33556 0.73984
STP stp-cms-exp-2016 default unsat ✅ 0.10904 0.10907
stp-cms-mt-2016 default unsat ✅ 0.11177 0.11189
stp-cms-st-2016 default unsat ✅ 0.11039 0.11084
stp-minisat-st-2016 default unsat ✅ 0.11061 0.11088
Yices2 Yices-2.4.2 default unsat ✅ 0.05719 0.05717
Z3 z3-4.4.1 default unsat ✅ 0.17809 0.17938
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.20291 0.20156
Boolector SMT17 final boolector unsat ✅ 0.20383 0.20383
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.16879 1.92017
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.18111 0.17988
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.33128 0.33122
Q3B Q3B default unsat ✅ 0.32364 0.69732
STP stp_st default unsat ✅ 0.13951 0.13891
stp_mt default unsat ✅ 0.15713 0.15601
Yices2 Yices2-Main default unsat ✅ 0.05429 0.05347
Z3 z3-4.5.0 default unsat ✅ 0.24418 0.24280
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.17788 0.17758
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.04895 1.04912
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.16802 0.16901
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.32827 0.32825
Minkeyrink ST_st unsat ✅ 0.32802 0.32803
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.13476 0.13483
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.13455 0.13455
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.13427 0.13428
Yices2 Yices 2.6.0_default unsat ✅ 0.05315 0.05306
Z3 z3-4.7.1_default unsat ✅ 0.18482 0.18475
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.32051 0.32048
Poolector-wrapped-sq_default unsat ✅ 0.47931 1.51718
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.26013 0.26008
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.04928 1.04953
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.27596 0.27609
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.27400 0.27410
Par4 Par4-wrapped-sq_default unsat ✅ 0.06027 0.00590
STP STP-2019-wrapped-sq_default unsat ✅ 0.13978 0.13985
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.14379 0.14396
stp-minisat-wrapped-sq_default unsat ✅ 0.14377 0.14385
stp-mt-wrapped-sq_default unsat ✅ 0.14400 0.14414
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.14338 0.14347
stp-riss-wrapped-sq_default unsat ✅ 0.14391 0.14406
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.05541 0.05540
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05508 0.05508
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05507 0.05509
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.05419 0.05418
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05509 0.05509
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.20395 0.20393