Benchmark

non-incremental/QF_BV/sage/app7/bench_1666.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1438578
Compressed Size106899
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1438570
Compressed Size106908
Max. Term Depth5531
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1554 and1
=2100 let5474 extract1213 bvand13870
bvor8986 bvxor1396 bvadd15388 bvmul1
bvsub4966 bvult428 bvule453 bvslt195
bvsle97 bvshl4808 bvashr8669 zero_extend930

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.20227 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.22340 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.21674 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.21710 —
abziz_portfolio_2012_solvers default unsat ✅ 0.21579 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.21597 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.28417 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.33321 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.29147 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 44.96240 —
CVC3-SMT-COMP-2011 default unsat ✅ 38.08410 —
CVC3-SMT-COMP-2012 default unsat ✅ 39.79510 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.18777 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.95378 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.44190 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.41847 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.55044 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.53182 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.38598 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.14637 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.59217 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.56536 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.21453 —
STP2-SMT-COMP-2012 default unsat ✅ 0.20322 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.20794 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.24446 —
Z3-SMT-COMP-2011 default unsat ✅ 0.21138 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.38997 0.38894
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.95153 3.19451
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.95283 3.20351
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.31485 0.31395
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.78000
STP stp-cryptominisat4 default unsat ✅ 0.19271 0.19197
stp-cmsat4-v15 default unsat ✅ 0.19393 0.19297
stp-cmsat4-mt-v15 default unsat ✅ 0.19321 0.19197
stp-minisat-v15 default unsat ✅ 0.19377 0.19297
Yices2 Yices default unsat ✅ 0.08842 0.08699
Z3 z3 4.4.0 default unsat ✅ 0.21649 0.21697
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.82571 0.82644
ABC_glucose glucose unsat ✅ 0.81953 0.81987
Boolector Boolector boolector unsat ✅ 0.49824 0.49834
Boolector preprop boolector unsat ✅ 0.48408 0.48435
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.90784 3.13334
MapleSTP MapleSTP default unsat ✅ 0.19081 0.19085
MapleSTP-mt default unsat ✅ 0.18383 0.18390
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.28575 0.28721
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.25012 0.25017
Q3B Q3B default unsat ✅ 0.46560 0.79849
STP stp-cms-exp-2016 default unsat ✅ 0.18794 0.18799
stp-cms-mt-2016 default unsat ✅ 0.19426 0.19422
stp-cms-st-2016 default unsat ✅ 0.19252 0.19256
stp-minisat-st-2016 default unsat ✅ 0.19180 0.19189
Yices2 Yices-2.4.2 default unsat ✅ 0.09026 0.09028
Z3 z3-4.4.1 default unsat ✅ 0.25743 0.25885
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.35512 0.35434
Boolector SMT17 final boolector unsat ✅ 0.36981 0.36917
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.88983 3.06674
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.29606 0.29522
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.55984 0.55442
Q3B Q3B default unsat ✅ 0.46340 1.11407
STP stp_st default unsat ✅ 0.23556 0.23466
stp_mt default unsat ✅ 0.25200 0.25099
Yices2 Yices2-Main default unsat ✅ 0.08539 0.08440
Z3 z3-4.5.0 default unsat ✅ 0.28104 0.28003
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.32518 0.32477
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.75751 1.75735
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.27946 0.28047
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.55996 0.55999
Minkeyrink ST_st unsat ✅ 0.55933 0.55917
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.23993 0.23999
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.23833 0.23837
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.23732 0.23736
Yices2 Yices 2.6.0_default unsat ✅ 0.08206 0.08178
Z3 z3-4.7.1_default unsat ✅ 0.30401 0.30390
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.76053 0.76042
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.33680 1.33496
STP STP 2022.4_default unsat ✅ 0.24767 0.24772
STP 2022.4_default unsat ✅ 0.24835 0.24833
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 427.74100 486.61100
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.09721 0.09718
Z3-Owl z3-Owl-Final_default unsat ✅ 0.89280 0.89242
z3-Owl-Final_default unsat ✅ 0.89609 0.89627
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.53212 0.41313
Bitwuzla-MachBV-base unsat ✅ 0.62959 0.50256
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.69910 0.58081
BVDecide bv_decide unsat ✅ 359.06685 358.87222
bv_decide-nokernel unsat ✅ 322.27976 322.11374
cvc5 cvc5 unsat ✅ 0.47244 0.35478
SMTInterpol SMTInterpol unknown ❌ 1201.88894 3308.14852
Yices2 Yices2 unsat ✅ 0.29247 0.17927
Z3alpha Z3-alpha unsat ✅ 0.61902 0.54237
Z3 Z3-alpha-base unsat ✅ 0.39825 0.27040
Z3-Owl-base unsat ✅ 0.70614 0.57602
z3siri-base unsat ✅ 0.36742 0.25056
Z3-Owl Z3-Owl unsat ✅ 0.91217 0.78360