Benchmark

non-incremental/QF_BV/sage/app12/bench_5581.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size56493
Compressed Size7655
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 56485
Compressed Size7668
Max. Term Depth56
Asserts 1
Declared Functions0
Declared Constants316
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite39 not229 and1
=409 let46 bvor148 bvadd162
bvsub208 bvult161 bvule144 bvslt37
bvsle36 bvshl155 zero_extend324

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.37908 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.31415 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.30516 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.31383 —
abziz_portfolio_2012_solvers default sat ✅ 0.30918 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.31165 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 5.05476 —
Boolector-SMT-COMP-2011 default sat ✅ 2.75978 —
Boolector-SMT-COMP-2012 default sat ✅ 0.03982 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 13.24370 —
CVC3-SMT-COMP-2011 default sat ✅ 11.88690 —
CVC3-SMT-COMP-2012 default sat ✅ 12.25810 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.29283 —
CVC4-SMT-EVAL-2013 default sat ✅ 17.23230 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.15744 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.76444 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.14843 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.15520 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.11025 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.35775 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.51149 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.11772 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.10251 —
STP2-SMT-COMP-2012 default sat ✅ 0.15131 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.37925 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.31103 —
Z3-SMT-COMP-2011 default sat ✅ 0.30315 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 3.15172 3.15252
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.58981 1.13583
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.59000 1.13583
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.69096 0.68989
SMT-RAT SMT-RAT-final default sat ✅ 175.67100 175.72600
STP stp-cryptominisat4 default sat ✅ 0.13742 0.13598
stp-cmsat4-v15 default sat ✅ 0.13783 0.13698
stp-cmsat4-mt-v15 default unknown ❌ 0.11975 0.11898
stp-minisat-v15 default sat ✅ 0.12234 0.12098
Yices2 Yices default sat ✅ 0.02044 0.01900
Z3 z3 4.4.0 default sat ✅ 0.25114 0.25096
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 25.87060 25.88060
ABC_glucose glucose sat ✅ 4.42098 4.41979
Boolector Boolector boolector sat ✅ 4.44372 4.44627
Boolector preprop boolector sat ✅ 4.20078 4.20397
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.60803 1.17544
MapleSTP MapleSTP default sat ✅ 0.14865 0.14924
MapleSTP-mt default sat ✅ 0.15978 0.35216
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.71437 0.71565
MinkeyRink Minkeyrink 2016 default sat ✅ 0.31432 0.44382
Q3B Q3B default unknown ❌ 2400.03000 7203.75000
STP stp-cms-exp-2016 default sat ✅ 0.14459 0.14463
stp-cms-mt-2016 default sat ✅ 0.15974 0.35227
stp-cms-st-2016 default sat ✅ 0.14090 0.14092
stp-minisat-st-2016 default sat ✅ 0.29692 0.29709
Yices2 Yices-2.4.2 default sat ✅ 0.02095 0.02094
Z3 z3-4.4.1 default sat ✅ 0.16225 0.16358
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.35388 1.35319
Boolector SMT17 final boolector sat ✅ 3.18623 3.18525
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.62520 1.20734
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.74950 0.75046
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.22646 0.14805
Q3B Q3B default unknown ❌ 600.09800 1029.30000
STP stp_st default sat ✅ 0.55633 0.72697
stp_mt default sat ✅ 0.61811 1.25211
Yices2 Yices2-Main default sat ✅ 0.01783 0.01681
Z3 z3-4.5.0 default sat ✅ 0.44399 0.44166
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.58654 0.58630
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.75148 0.75148
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.70537 0.70623
MinkeyRink Minkeyrink MT_mt sat ✅ 0.09187 0.10538
Minkeyrink ST_st sat ✅ 0.08752 0.08768
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.57681 0.57668
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.56637 1.00089
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.44508 1.44517
Yices2 Yices 2.6.0_default sat ✅ 0.01932 0.01927
Z3 z3-4.7.1_default sat ✅ 0.42217 0.42204
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.22226 0.22221
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.39363 0.39428
STP STP 2022.4_default sat ✅ 0.10608 0.10607
STP 2022.4_default sat ✅ 0.10760 0.10765
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1262.04000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.01880 0.01878
Z3-Owl z3-Owl-Final_default sat ✅ 10.70580 10.70520
z3-Owl-Final_default sat ✅ 10.73210 21.34080
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.29289 0.16959
Bitwuzla-MachBV-base sat ✅ 0.31196 0.18770
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.94063 0.80853
BVDecide bv_decide sat ✅ 6.49590 6.34161
bv_decide-nokernel sat ✅ 6.01510 5.85938
cvc5 cvc5 sat ✅ 0.52787 0.40040
SMTInterpol SMTInterpol unknown ❌ 1201.47472 1227.27404
Yices2 Yices2 sat ✅ 0.35791 0.23104
Z3alpha Z3-alpha sat ✅ 0.70606 1.38929
Z3 Z3-alpha-base sat ✅ 0.98779 0.86726
Z3-Owl-base sat ✅ 3.46653 3.33245
z3siri-base sat ✅ 1.08061 0.94459
Z3-Owl Z3-Owl sat ✅ 4.13674 4.00716