Benchmark

non-incremental/QF_BV/sage/app8/bench_1378.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size34945
Compressed Size6023
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 34937
Compressed Size6036
Max. Term Depth92
Asserts 1
Declared Functions0
Declared Constants166
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite1 not105 and1
=200 let82 extract20 bvand25
bvor72 bvadd238 bvsub62 bvult112
bvule181 bvsle3 bvshl79 zero_extend161

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.34852 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.17991 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.18400 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.17965 —
abziz_portfolio_2012_solvers default unsat ✅ 0.19568 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.17847 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.05157 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.05954 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.04802 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 5.00906 —
CVC3-SMT-COMP-2011 default unsat ✅ 4.53655 —
CVC3-SMT-COMP-2012 default unsat ✅ 4.65662 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.40986 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.47553 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.17204 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.30696 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.14723 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.17542 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.07390 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.11153 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.29264 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.07841 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.02119 —
STP2-SMT-COMP-2012 default unsat ✅ 0.02628 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.05444 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.18718 —
Z3-SMT-COMP-2011 default unsat ✅ 0.17478 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.05812 0.05699
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.62186 1.20882
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.62201 1.21181
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.32210 0.32095
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.80000
STP stp-cryptominisat4 default unsat ✅ 0.02895 0.02799
stp-cmsat4-v15 default unsat ✅ 0.02730 0.02600
stp-cmsat4-mt-v15 default unsat ✅ 0.02776 0.02700
stp-minisat-v15 default unsat ✅ 0.02717 0.02600
Yices2 Yices default unsat ✅ 0.00798 0.00500
Z3 z3 4.4.0 default unsat ✅ 0.22254 0.22296
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 0.39312 0.39322
ABC_glucose glucose unsat ✅ 4.61069 4.61284
Boolector Boolector boolector unsat ✅ 0.14289 0.14292
Boolector preprop boolector unsat ✅ 0.17002 0.17061
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.47253 0.91103
MapleSTP MapleSTP default unsat ✅ 0.02413 0.02408
MapleSTP-mt default unsat ✅ 0.02552 0.02547
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.38055 0.38175
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.03171 0.03200
Q3B Q3B default unknown ❌ 2400.11000 7203.53000
STP stp-cms-exp-2016 default unsat ✅ 0.02466 0.02461
stp-cms-mt-2016 default unsat ✅ 0.02592 0.02589
stp-cms-st-2016 default unsat ✅ 0.02591 0.02588
stp-minisat-st-2016 default unsat ✅ 0.02565 0.02563
Yices2 Yices-2.4.2 default unsat ✅ 0.01550 0.00668
Z3 z3-4.4.1 default unsat ✅ 0.21951 0.22090
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.27207 0.27121
Boolector SMT17 final boolector unsat ✅ 0.26194 0.25939
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.59696 1.15735
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.20906 0.20958
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.02561 0.02565
Q3B Q3B default unknown ❌ 600.10900 1799.61000
STP stp_st default unsat ✅ 0.06569 0.06569
stp_mt default unsat ✅ 0.06581 0.06432
Yices2 Yices2-Main default unsat ✅ 0.01749 0.01744
Z3 z3-4.5.0 default unsat ✅ 0.19739 0.19625
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.26714 0.26706
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.34529 1.34515
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.33829 0.33931
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.02641 0.02645
Minkeyrink ST_st unsat ✅ 0.02910 0.02665
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.07346 0.07347
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.07312 0.07321
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.07316 0.07320
Yices2 Yices 2.6.0_default unsat ✅ 0.00881 0.00873
Z3 z3-4.7.1_default unsat ✅ 0.22460 0.22450
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.26319 0.26310
Boolector Boolector-wrapped-sq_default unsat ✅ 0.26182 0.26184
Poolector-wrapped-sq_default unsat ✅ 0.17935 0.22931
CVC4 CVC4-sq-final_default unsat ✅ 0.58724 0.58757
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 42.78050 42.77280
MathSAT MathSAT5_default.sh unsat ✅ 0.14977 0.14971
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.02818 0.02830
MinkeyRink Solver 2020.3_default unsat ✅ 0.02957 0.02965
STP STP_default unsat ✅ 0.05568 0.05578
STP ++ Mergsat v1_default unsat ✅ 0.05141 0.05306
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02031 0.01943
Z3 z3-4.8.8_default unsat ✅ 0.15560 0.15550
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.26290 0.26285
MathSAT mathsat-5.6.6_default unsat ✅ 0.16901 0.16898
STP STP 2021.0_default unsat ✅ 0.05180 0.05190
Z3 z3-4.8.11_default unsat ✅ 0.12104 0.12101
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.32587 0.20667
Bitwuzla-MachBV-base unsat ✅ 0.48025 0.35307
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.46271 0.33690
BVDecide bv_decide unsat ✅ 6.81722 6.65771
bv_decide-nokernel unsat ✅ 3.84909 3.68221
cvc5 cvc5 unsat ✅ 0.62332 0.50546
SMTInterpol SMTInterpol unsat ✅ 4.16815 12.10883
Yices2 Yices2 unsat ✅ 0.29530 0.16736
Z3alpha Z3-alpha unsat ✅ 0.37484 0.29620
Z3 Z3-alpha-base unsat ✅ 0.27855 0.16110
Z3-Owl-base unsat ✅ 0.30922 0.18649
z3siri-base unsat ✅ 0.28447 0.16440
Z3-Owl Z3-Owl unsat ✅ 0.82213 0.69760