Benchmark

non-incremental/QF_BV/sage/app1/bench_2630.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size63645
Compressed Size8777
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 63637
Compressed Size8764
Max. Term Depth125
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite54 not69 and1
=175 let115 extract1 bvand32
bvor171 bvadd330 bvmul5 bvsub168
bvult197 bvule441 bvslt1 bvsle27
bvshl172 bvashr5 zero_extend282

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.69505 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.19418 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.19876 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.19927 —
abziz_portfolio_2012_solvers default unsat ✅ 0.19537 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.19407 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.09096 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.08759 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.08399 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.44112 —
CVC3-SMT-COMP-2011 default unsat ✅ 2.20307 —
CVC3-SMT-COMP-2012 default unsat ✅ 2.25442 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.42831 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.56829 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.22689 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.51854 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.23033 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.22658 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.17300 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.22405 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.52031 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.17485 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.03352 —
STP2-SMT-COMP-2012 default unsat ✅ 0.03389 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.06496 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.20278 —
Z3-SMT-COMP-2011 default unsat ✅ 0.18910 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.01719 0.01600
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.81556 1.57876
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.82637 1.60676
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.64568 0.64490
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.03000
STP stp-cryptominisat4 default unsat ✅ 0.03717 0.03599
stp-cmsat4-v15 default unsat ✅ 0.03578 0.03499
stp-cmsat4-mt-v15 default unsat ✅ 0.03582 0.03499
stp-minisat-v15 default unsat ✅ 0.03518 0.03399
Yices2 Yices default unsat ✅ 0.03441 0.03299
Z3 z3 4.4.0 default unsat ✅ 0.23942 0.23896
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 0.75176 0.75163
ABC_glucose glucose unsat ✅ 9.50020 9.50612
Boolector Boolector boolector unsat ✅ 0.01876 0.01915
Boolector preprop boolector unsat ✅ 0.01782 0.01778
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.77689 1.51079
MapleSTP MapleSTP default unsat ✅ 0.03388 0.03438
MapleSTP-mt default unsat ✅ 0.03357 0.03385
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.57185 0.57310
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.04448 0.04447
Q3B Q3B default unknown ❌ 2400.03000 7203.06000
STP stp-cms-exp-2016 default unsat ✅ 0.03291 0.03289
stp-cms-mt-2016 default unsat ✅ 0.03491 0.03554
stp-cms-st-2016 default unsat ✅ 0.03307 0.03306
stp-minisat-st-2016 default unsat ✅ 0.03295 0.03293
Yices2 Yices-2.4.2 default unsat ✅ 0.03378 0.03376
Z3 z3-4.4.1 default unsat ✅ 0.25936 0.26076
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02067 0.02053
Boolector SMT17 final boolector unsat ✅ 0.02014 0.01982
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.78125 1.51656
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.63140 0.63234
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.03684 0.03587
Q3B Q3B default unsat ✅ 0.26019 0.50169
STP stp_st default unsat ✅ 0.04496 0.04381
stp_mt default unsat ✅ 0.04517 0.04394
Yices2 Yices2-Main default unsat ✅ 0.03237 0.03278
Z3 z3-4.5.0 default unsat ✅ 0.26600 0.26503
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.01514 0.01506
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.42211 1.42207
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.51740 0.51841
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.03855 0.03865
Minkeyrink ST_st unsat ✅ 0.03888 0.03891
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.04301 0.04309
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.04315 0.04318
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.04325 0.04327
Yices2 Yices 2.6.0_default unsat ✅ 0.02939 0.02929
Z3 z3-4.7.1_default unsat ✅ 0.27055 0.27048
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.03126 0.03123
Poolector-wrapped-sq_default unsat ✅ 0.17621 0.21192
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.02648 0.02649
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.76675 0.76694
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.04905 0.04923
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.04743 0.04750
Par4 Par4-wrapped-sq_default unsat ✅ 0.02489 0.00581
STP STP-2019-wrapped-sq_default unsat ✅ 0.07155 0.07165
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.07146 0.07160
stp-minisat-wrapped-sq_default unsat ✅ 0.07096 0.07112
stp-mt-wrapped-sq_default unsat ✅ 0.07193 0.07206
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.07224 0.07237
stp-riss-wrapped-sq_default unsat ✅ 0.07226 0.07242
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03573 0.03571
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.03540 0.03541
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.03589 0.03590
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.08642 0.08643
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.03549 0.03548
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.25601 0.25593
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.24776 0.14760
cvc5 cvc5 unsat ✅ 0.87499 0.77542
SMTInterpol SMTInterpol unknown ❌ 1201.71263 1237.15813
STP STP unsat ✅ 0.25369 0.15370
Yices2 Yices2 unsat ✅ 0.25936 0.15954
Z3alpha Z3-alpha unsat ✅ 0.28871 0.18890
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.28450 0.16473
Bitwuzla-MachBV-base unsat ✅ 0.30631 0.17950
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.47075 0.34931
BVDecide bv_decide unsat ✅ 11.97047 11.79446
bv_decide-nokernel unsat ✅ 6.04503 5.91407
cvc5 cvc5 unsat ✅ 0.74370 0.61582
SMTInterpol SMTInterpol unknown ❌ 1201.58312 1225.14906
Yices2 Yices2 unsat ✅ 0.31347 0.18242
Z3alpha Z3-alpha unsat ✅ 0.42596 0.36426
Z3 Z3-alpha-base unsat ✅ 0.32581 0.20126
Z3-Owl-base unsat ✅ 0.38729 0.25282
z3siri-base unsat ✅ 0.30611 0.18315
Z3-Owl Z3-Owl unsat ✅ 0.81687 0.69753