Benchmark

non-incremental/QF_BV/sage/app12/bench_183.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size49458
Compressed Size6868
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 49450
Compressed Size6872
Max. Term Depth52
Asserts 1
Declared Functions0
Declared Constants284
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite35 not190 and1
=347 let42 bvor132 bvadd144
bvsub171 bvult144 bvule128 bvslt29
bvsle28 bvshl137 zero_extend292

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.34680 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.25446 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.25234 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.25201 —
abziz_portfolio_2012_solvers default sat ✅ 0.25673 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.25319 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 4.52524 —
Boolector-SMT-COMP-2011 default sat ✅ 2.63906 —
Boolector-SMT-COMP-2012 default sat ✅ 0.03696 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 10.49650 —
CVC3-SMT-COMP-2011 default sat ✅ 9.43052 —
CVC3-SMT-COMP-2012 default sat ✅ 9.62719 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.30050 —
CVC4-SMT-EVAL-2013 default sat ✅ 17.29680 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.15057 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.77462 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.13912 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.15053 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.10343 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.20584 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.42077 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.11726 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.08534 —
STP2-SMT-COMP-2012 default sat ✅ 0.14396 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.27409 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.26708 —
Z3-SMT-COMP-2011 default sat ✅ 0.25421 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 2.33379 2.33364
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.55030 1.05784
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.64371 1.24881
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.75178 0.75089
SMT-RAT SMT-RAT-final default sat ✅ 165.13700 165.16300
STP stp-cryptominisat4 default sat ✅ 0.13906 0.13798
stp-cmsat4-v15 default sat ✅ 0.12053 0.11898
stp-cmsat4-mt-v15 default unknown ❌ 0.10850 0.10698
stp-minisat-v15 default sat ✅ 0.11514 0.11398
Yices2 Yices default sat ✅ 0.01547 0.01400
Z3 z3 4.4.0 default sat ✅ 0.25771 0.25796
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 18.22000 18.23270
ABC_glucose glucose sat ✅ 3.58708 3.58924
Boolector Boolector boolector sat ✅ 7.25785 7.26239
Boolector preprop boolector sat ✅ 7.01784 7.02182
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.56731 1.09833
MapleSTP MapleSTP default sat ✅ 0.22081 0.22091
MapleSTP-mt default sat ✅ 0.22834 0.53640
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.60173 0.60166
MinkeyRink Minkeyrink 2016 default sat ✅ 0.28739 0.42389
Q3B Q3B default unknown ❌ 2400.03000 7203.12000
STP stp-cms-exp-2016 default sat ✅ 0.23493 0.23535
stp-cms-mt-2016 default sat ✅ 0.22882 0.53321
stp-cms-st-2016 default sat ✅ 0.21385 0.21393
stp-minisat-st-2016 default sat ✅ 0.61765 0.61790
Yices2 Yices-2.4.2 default sat ✅ 0.01717 0.01748
Z3 z3-4.4.1 default sat ✅ 0.15766 0.15896
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.33502 1.33206
Boolector SMT17 final boolector sat ✅ 3.86776 3.86656
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.78860 1.49668
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.68440 0.68430
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.40248 0.14731
Q3B Q3B default unknown ❌ 600.03500 1186.61000
STP stp_st default sat ✅ 1.18967 1.18894
stp_mt default sat ✅ 1.31917 3.67582
Yices2 Yices2-Main default sat ✅ 0.01674 0.01620
Z3 z3-4.5.0 default sat ✅ 0.51324 0.51224
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.52472 0.52446
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.67631 0.67648
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.62285 0.62371
MinkeyRink Minkeyrink MT_mt sat ✅ 0.08560 0.09852
Minkeyrink ST_st sat ✅ 0.08094 0.08112
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.44717 0.44731
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.48717 0.69040
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.44083 1.44070
Yices2 Yices 2.6.0_default sat ✅ 0.02072 0.02064
Z3 z3-4.7.1_default sat ✅ 0.43473 0.43461
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.94997 0.94995
Poolector-wrapped-sq_default sat ✅ 0.68549 2.22903
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 4.52425 4.52378
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.41956 0.41980
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.08606 0.09527
MinkeyRink ST-wrapped-sq_default sat ✅ 0.07958 0.07965
Par4 Par4-wrapped-sq_default sat ✅ 0.02836 0.00582
STP STP-2019-wrapped-sq_default sat ✅ 0.30627 0.30658
stp-mergesat-fixed-wrapped-sq_default sat ✅ 0.36275 0.36296
stp-minisat-wrapped-sq_default sat ✅ 0.31192 0.31216
stp-mt-wrapped-sq_default sat ✅ 0.31574 0.51478
stp-portfolio-fixed-wrapped-sq_default sat ✅ 0.40689 0.64534
stp-riss-wrapped-sq_default unknown ❌ 0.24154 0.24174
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.02241 0.02242
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.03258 0.03259
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.07709 0.07711
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 1.24446 1.24436
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.03348 0.03347
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.34820 0.34819
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.05440 1.05434
Boolector Boolector-wrapped-sq_default sat ✅ 0.74268 0.74257
Poolector-wrapped-sq_default sat ✅ 0.67904 2.26000
CVC4 CVC4-sq-final_default sat ✅ 0.39438 0.39451
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.09000 1199.89000
MathSAT MathSAT5_default.sh sat ✅ 0.17704 0.17699
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.07825 0.07848
MinkeyRink Solver 2020.3_default sat ✅ 0.08181 0.09199
STP STP_default sat ✅ 0.10395 0.12166
STP ++ Mergsat v1_default sat ✅ 0.10135 0.10304
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.04083 0.04074
Z3 z3-4.8.8_default sat ✅ 0.42225 0.42216
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.01918 1.01908
Bitwuzla-wrapped_default sat ✅ 0.94915 0.94910
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.38006 0.37954
MathSAT MathSAT-5.6.8_default sat ✅ 0.17921 0.17917
STP STP 2022.4_default sat ✅ 0.08955 0.08957
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.04610 0.04607
Z3++BV z3++bv_0702_default sat ✅ 0.12990 0.12982
Z3 z3-4.8.17_default sat ✅ 0.47560 0.47727
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.30177 0.17819
Bitwuzla-MachBV-base sat ✅ 0.33043 0.20806
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.91524 0.78579
BVDecide bv_decide sat ✅ 5.64495 5.49641
bv_decide-nokernel sat ✅ 5.28378 5.13729
cvc5 cvc5 sat ✅ 0.44387 0.32661
SMTInterpol SMTInterpol unknown ❌ 1201.47573 1228.73437
Yices2 Yices2 sat ✅ 0.29231 0.16615
Z3alpha Z3-alpha sat ✅ 0.73289 1.35419
Z3 Z3-alpha-base sat ✅ 1.03150 0.90164
Z3-Owl-base sat ✅ 3.27853 3.15985
z3siri-base sat ✅ 1.01260 0.87738
Z3-Owl Z3-Owl sat ✅ 5.05234 4.92838