Benchmark

non-incremental/QF_BV/sage/app7/bench_1040.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2457378
Compressed Size159041
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2457370
Compressed Size159047
Max. Term Depth9470
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1765 and1
=2372 let9371 extract1296 bvand25263
bvor16570 bvxor1538 bvadd27013 bvmul1
bvsub8734 bvult442 bvule485 bvslt206
bvsle103 bvshl8568 bvashr16141 zero_extend1019

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.37018 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.39957 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.39522 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.39703 —
abziz_portfolio_2012_solvers default unsat ✅ 0.39910 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.39719 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.49735 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.58180 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.52428 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 211.73600 —
CVC3-SMT-COMP-2011 default unsat ✅ 177.57600 —
CVC3-SMT-COMP-2012 default unsat ✅ 185.39200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.03581 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.18656 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.75176 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.72400 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.93329 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.90617 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.64684 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.13520 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.58773 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.01181 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.39033 —
STP2-SMT-COMP-2012 default unsat ✅ 0.38343 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.38155 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.45860 —
Z3-SMT-COMP-2011 default unsat ✅ 0.39572 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.71714 0.71689
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.23265 5.21621
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.22049 5.20421
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.50405 0.50292
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.00000
STP stp-cryptominisat4 default unsat ✅ 0.34981 0.34895
stp-cmsat4-v15 default unsat ✅ 0.35590 0.35495
stp-cmsat4-mt-v15 default unsat ✅ 0.35036 0.34895
stp-minisat-v15 default unsat ✅ 0.35881 0.35795
Yices2 Yices default unsat ✅ 0.14492 0.14398
Z3 z3 4.4.0 default unsat ✅ 0.41258 0.41294
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.40459 1.40525
ABC_glucose glucose unsat ✅ 1.39722 1.39825
Boolector Boolector boolector unsat ✅ 0.81350 0.81450
Boolector preprop boolector unsat ✅ 0.79272 0.79346
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.15934 5.11880
MapleSTP MapleSTP default unsat ✅ 0.33469 0.33517
MapleSTP-mt default unsat ✅ 0.33517 0.33533
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.44796 0.44920
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.45530 0.45549
Q3B Q3B default unsat ✅ 0.68412 1.56000
STP stp-cms-exp-2016 default unsat ✅ 0.34075 0.34115
stp-cms-mt-2016 default unsat ✅ 0.34689 0.34702
stp-cms-st-2016 default unsat ✅ 0.34565 0.34600
stp-minisat-st-2016 default unsat ✅ 0.34636 0.34653
Yices2 Yices-2.4.2 default unsat ✅ 0.14213 0.14217
Z3 z3-4.4.1 default unsat ✅ 0.36235 0.36381
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.66485 0.66300
Boolector SMT17 final boolector unsat ✅ 0.66315 0.66170
CVC4 CVC4-smtcomp2017-main default unsat ✅ 10.64410 5.66110
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.52572 0.51277
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.95359 0.95298
Q3B Q3B default unsat ✅ 0.88904 1.72000
STP stp_st default unsat ✅ 0.43524 0.43514
stp_mt default unsat ✅ 0.43695 0.43589
Yices2 Yices2-Main default unsat ✅ 0.13476 0.13468
Z3 z3-4.5.0 default unsat ✅ 0.46721 0.46448
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.58853 0.58842
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.93920 2.93925
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.45093 0.45195
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.94761 0.94757
Minkeyrink ST_st unsat ✅ 0.94850 0.94849
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.43205 0.43211
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.43192 0.43196
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.47430 0.47435
Yices2 Yices 2.6.0_default unsat ✅ 0.13022 0.13010
Z3 z3-4.7.1_default unsat ✅ 0.50984 0.50980
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.92721 0.82734
cvc5 cvc5 unsat ✅ 1.04020 0.94018
SMTInterpol SMTInterpol unknown ❌ 1202.75638 1842.84763
STP STP unsat ✅ 16.91372 16.81324
Yices2 Yices2 unsat ✅ 0.31766 0.21781
Z3alpha Z3-alpha unsat ✅ 0.45615 0.35683
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.81822 0.69152
Bitwuzla-MachBV-base unsat ✅ 0.90876 0.78204
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.01902 0.89982
BVDecide bv_decide unknown ❌ 1201.35943 1200.90787
bv_decide-nokernel unknown ❌ 1201.38943 1201.07482
cvc5 cvc5 unsat ✅ 0.74922 0.63162
SMTInterpol SMTInterpol unknown ❌ 1201.89461 2939.36536
Yices2 Yices2 unsat ✅ 0.36275 0.23918
Z3alpha Z3-alpha unsat ✅ 0.73764 0.68656
Z3 Z3-alpha-base unsat ✅ 0.47738 0.35861
Z3-Owl-base unsat ✅ 1.14563 1.02699
z3siri-base unsat ✅ 0.50413 0.37500
Z3-Owl Z3-Owl unsat ✅ 1.03913 0.91189