Benchmark

non-incremental/QF_BV/sage/app12/bench_1618.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size27683
Compressed Size3733
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status unsat
Size 27675
Compressed Size3743
Max. Term Depth45
Asserts 1
Declared Functions0
Declared Constants170
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite23 not91 and1
=166 let35 bvor78 bvadd91
bvsub73 bvult89 bvule69 bvslt10
bvsle8 bvshl78 zero_extend178

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.23542 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.12186 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.12052 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.12144 —
abziz_portfolio_2012_solvers default unsat ✅ 0.12391 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.12132 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.03410 —
Boolector-SMT-COMP-2011 default unsat ✅ 2.57616 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.02883 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 8.88234 —
CVC3-SMT-COMP-2011 default unsat ✅ 7.94027 —
CVC3-SMT-COMP-2012 default unsat ✅ 8.17232 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.23275 —
CVC4-SMT-EVAL-2013 default unsat ✅ 17.10060 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.56983 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.67106 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.16122 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.45578 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.08950 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.17944 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.18379 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.09460 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.07221 —
STP2-SMT-COMP-2012 default unsat ✅ 0.13203 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.26313 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.13418 —
Z3-SMT-COMP-2011 default unsat ✅ 0.11596 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 4.66472 4.66329
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.40758 0.78388
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.45142 0.87287
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.65797 0.65690
SMT-RAT SMT-RAT-final default sat ✅ 137.44300 137.49500
STP stp-cryptominisat4 default sat ✅ 0.11756 0.11698
stp-cmsat4-v15 default sat ✅ 0.10361 0.10298
stp-cmsat4-mt-v15 default unknown ❌ 0.09875 0.09698
stp-minisat-v15 default sat ✅ 0.10432 0.10298
Yices2 Yices default sat ✅ 0.01319 0.01200
Z3 z3 4.4.0 default sat ✅ 0.13113 0.13098
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 6.35770 6.36122
ABC_glucose glucose sat ✅ 2.26389 2.26587
Boolector Boolector boolector sat ✅ 2.79097 2.79251
Boolector preprop boolector sat ✅ 2.71388 2.71508
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.39692 0.76909
MapleSTP MapleSTP default sat ✅ 0.12300 0.12362
MapleSTP-mt default sat ✅ 0.13811 0.32784
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.61080 0.61219
MinkeyRink Minkeyrink 2016 default sat ✅ 0.27805 0.42145
Q3B Q3B default unknown ❌ 2400.02000 7203.28000
STP stp-cms-exp-2016 default sat ✅ 0.12781 0.12784
stp-cms-mt-2016 default sat ✅ 0.13652 0.32515
stp-cms-st-2016 default sat ✅ 0.12513 0.12518
stp-minisat-st-2016 default sat ✅ 0.10645 0.10649
Yices2 Yices-2.4.2 default sat ✅ 0.01534 0.01531
Z3 z3-4.4.1 default sat ✅ 0.14069 0.14202
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.31692 1.31104
Boolector SMT17 final boolector sat ✅ 2.03102 2.02762
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.36361 0.69909
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.61049 0.61054
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.16807 0.12310
Q3B Q3B default unknown ❌ 600.04200 1799.75000
STP stp_st default sat ✅ 1.01685 1.01374
stp_mt default sat ✅ 1.09814 3.18911
Yices2 Yices2-Main default sat ✅ 0.01366 0.01358
Z3 z3-4.5.0 default sat ✅ 0.39475 0.39370
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.52965 0.52951
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.67441 0.67438
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.52756 0.52860
MinkeyRink Minkeyrink MT_mt sat ✅ 0.07145 0.08586
Minkeyrink ST_st sat ✅ 0.06592 0.06610
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.44261 0.44254
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.42581 0.62392
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.32067 1.32051
Yices2 Yices 2.6.0_default sat ✅ 0.01553 0.01546
Z3 z3-4.7.1_default sat ✅ 0.34924 0.34911
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.99008 0.99004
Poolector-wrapped-sq_default sat ✅ 0.58315 1.96000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 2.12082 2.12070
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.19831 0.19856
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.06827 0.07862
MinkeyRink ST-wrapped-sq_default sat ✅ 0.06246 0.06253
Par4 Par4-wrapped-sq_default sat ✅ 0.02529 0.00618
STP STP-2019-wrapped-sq_default sat ✅ 0.19817 0.19854
stp-mergesat-fixed-wrapped-sq_default sat ✅ 6.71718 6.71667
stp-minisat-wrapped-sq_default sat ✅ 0.26052 0.26071
stp-mt-wrapped-sq_default sat ✅ 0.20721 0.26561
stp-portfolio-fixed-wrapped-sq_default sat ✅ 6.80572 6.95064
stp-riss-wrapped-sq_default unknown ❌ 0.18787 0.18809
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.01697 0.01697
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.02819 0.02822
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.06692 0.06694
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 314.67700 314.64600
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.03056 0.03060
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.27920 0.27918
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.04387 1.04382
MathSAT mathsat-5.6.6_default sat ✅ 0.13953 0.13950
STP STP 2021.0_default sat ✅ 0.12884 0.24271
Z3 z3-4.8.11_default sat ✅ 0.43777 0.43769
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.28527 0.18533
cvc5 cvc5 sat ✅ 0.40142 0.30204
SMTInterpol SMTInterpol unknown ❌ 1201.74604 1233.65200
STP STP sat ✅ 0.39738 0.29757
Yices2 Yices2 sat ✅ 0.21944 0.11977
Z3alpha Z3-alpha sat ✅ 0.33023 0.23034
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.31019 0.18235
Bitwuzla-MachBV-base sat ✅ 0.30790 0.19080
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.86803 0.74476
BVDecide bv_decide sat ✅ 3.42493 3.25819
bv_decide-nokernel sat ✅ 3.43248 3.26321
cvc5 cvc5 sat ✅ 0.40893 0.28514
SMTInterpol SMTInterpol unknown ❌ 1201.36502 1226.15921
Yices2 Yices2 sat ✅ 0.28943 0.16522
Z3alpha Z3-alpha sat ✅ 0.54191 0.81300
Z3 Z3-alpha-base sat ✅ 1.02521 0.90851
Z3-Owl-base sat ✅ 3.41454 3.29809
z3siri-base sat ✅ 1.09220 0.96842
Z3-Owl Z3-Owl sat ✅ 4.81136 4.68888