Benchmark

non-incremental/QF_BV/sage/app1/bench_1931.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size77245
Compressed Size10896
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 77237
Compressed Size10888
Max. Term Depth181
Asserts 1
Declared Functions0
Declared Constants290
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite82 not75 and1
=200 let171 extract1 bvand44
bvor174 bvadd380 bvmul5 bvsub255
bvult267 bvule583 bvslt2 bvsle57
bvshl175 bvashr5 zero_extend314

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.89 (1/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default unknown ❌ — —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.04055 —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02371 0.02300
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.05901 2.06069
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.09770 2.13867
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.95324 0.95285
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.93000
STP stp-cryptominisat4 default unsat ✅ 0.06618 0.06499
stp-cmsat4-v15 default unsat ✅ 0.06467 0.06399
stp-cmsat4-mt-v15 default unsat ✅ 0.06484 0.06399
stp-minisat-v15 default unsat ✅ 0.06444 0.06299
Yices2 Yices default unsat ✅ 0.04387 0.04299
Z3 z3 4.4.0 default unsat ✅ 0.32563 0.32595
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.93611 0.93636
ABC_glucose glucose unsat ✅ 12.93060 12.93390
Boolector Boolector boolector unsat ✅ 0.02702 0.02746
Boolector preprop boolector unsat ✅ 0.02696 0.02693
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.05924 2.06710
MapleSTP MapleSTP default unsat ✅ 0.04663 0.04660
MapleSTP-mt default unsat ✅ 0.04644 0.04642
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.74135 0.74278
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.05914 0.05911
Q3B Q3B default unsat ✅ 0.46342 1.11849
STP stp-cms-exp-2016 default unsat ✅ 0.04855 0.04697
stp-cms-mt-2016 default unsat ✅ 0.04745 0.04692
stp-cms-st-2016 default unsat ✅ 0.04781 0.04775
stp-minisat-st-2016 default unsat ✅ 0.04636 0.04633
Yices2 Yices-2.4.2 default unsat ✅ 0.04344 0.04342
Z3 z3-4.4.1 default unsat ✅ 0.34276 0.34415
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02807 0.02740
Boolector SMT17 final boolector unsat ✅ 0.02795 0.02789
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.08646 2.11590
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.77468 0.77537
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.04347 0.04301
Q3B Q3B default unsat ✅ 0.52475 1.29295
STP stp_st default unsat ✅ 0.07047 0.06950
stp_mt default unsat ✅ 0.07084 0.07096
Yices2 Yices2-Main default unsat ✅ 0.04659 0.04544
Z3 z3-4.5.0 default unsat ✅ 0.38059 0.37888
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.04799 0.04789
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.86931 1.86972
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.79745 0.79852
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04295 0.04299
Minkeyrink ST_st unsat ✅ 0.04277 0.04279
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.11102 0.11102
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.11088 0.11090
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.11063 0.11061
Yices2 Yices 2.6.0_default unsat ✅ 0.03951 0.03939
Z3 z3-4.7.1_default unsat ✅ 0.33476 0.33468
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.04402 0.04399
MathSAT mathsat-5.6.6_default unsat ✅ 0.53928 0.53926
STP STP 2021.0_default unsat ✅ 0.08485 0.08494
Z3 z3-4.8.11_default unsat ✅ 0.40019 0.40015
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.04246 0.04240
Bitwuzla-wrapped_default unsat ✅ 0.04486 0.04483
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.88506 0.88564
MathSAT MathSAT-5.6.8_default unsat ✅ 0.58053 0.58038
STP STP 2022.4_default unsat ✅ 0.03715 0.03716
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.04519 0.04510
Z3++BV z3++bv_0702_default unsat ✅ 0.48210 0.48205
Z3 z3-4.8.17_default unsat ✅ 0.59318 0.59502
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.31979 0.19295
Bitwuzla-MachBV-base unsat ✅ 0.27343 0.15332
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.39790 0.28000
BVDecide bv_decide unsat ✅ 15.88117 15.74748
bv_decide-nokernel unsat ✅ 8.57191 8.43664
cvc5 cvc5 unsat ✅ 0.86901 0.73918
SMTInterpol SMTInterpol unknown ❌ 1201.79320 1227.87595
Yices2 Yices2 unsat ✅ 0.30929 0.18443
Z3alpha Z3-alpha unsat ✅ 0.41235 0.38409
Z3 Z3-alpha-base unsat ✅ 0.29188 0.17177
Z3-Owl-base unsat ✅ 0.39574 0.26046
z3siri-base unsat ✅ 0.31632 0.18926
Z3-Owl Z3-Owl unsat ✅ 0.83695 0.69998