Benchmark

non-incremental/QF_BV/sage/app7/bench_598.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3167835
Compressed Size199373
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3167827
Compressed Size199360
Max. Term Depth12170
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1918 and1
=2562 let12065 extract1401 bvand33159
bvor21885 bvxor1702 bvadd35113 bvmul1
bvsub11391 bvult461 bvule505 bvslt210
bvsle116 bvshl11207 bvashr21287 zero_extend1126

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.47449 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.70805 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.72282 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.71248 —
abziz_portfolio_2012_solvers default unsat ✅ 0.70604 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.71133 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.63972 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.77626 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.67142 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 344.66300 —
CVC3-SMT-COMP-2011 default unsat ✅ 288.31200 —
CVC3-SMT-COMP-2012 default unsat ✅ 300.53700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.69749 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.16033 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.94881 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.90818 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.18720 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.16173 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.82702 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.80378 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.96299 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.28878 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51136 —
STP2-SMT-COMP-2012 default unsat ✅ 0.47492 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.49315 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.74660 —
Z3-SMT-COMP-2011 default unsat ✅ 0.70362 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.93084 0.92986
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.13814 6.70598
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.18920 6.80196
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.66566 0.66490
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.86000
STP stp-cryptominisat4 default unsat ✅ 0.44468 0.44393
stp-cmsat4-v15 default unsat ✅ 0.44522 0.44393
stp-cmsat4-mt-v15 default unsat ✅ 0.44196 0.44093
stp-minisat-v15 default unsat ✅ 0.45315 0.45193
Yices2 Yices default unsat ✅ 0.17778 0.17697
Z3 z3 4.4.0 default unsat ✅ 0.52359 0.52392
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.77551 3.45658
ABC_glucose glucose unsat ✅ 1.78400 1.78477
Boolector Boolector boolector unsat ✅ 1.01047 1.01132
Boolector preprop boolector unsat ✅ 0.98121 0.98171
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.12985 6.72304
MapleSTP MapleSTP default unsat ✅ 0.42757 0.42778
MapleSTP-mt default unsat ✅ 0.43647 0.43666
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.59982 0.60090
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.59807 0.59831
Q3B Q3B default unsat ✅ 0.85857 1.98000
STP stp-cms-exp-2016 default unsat ✅ 0.43584 0.43601
stp-cms-mt-2016 default unsat ✅ 0.44347 0.44363
stp-cms-st-2016 default unsat ✅ 0.44350 0.44373
stp-minisat-st-2016 default unsat ✅ 0.44390 0.44413
Yices2 Yices-2.4.2 default unsat ✅ 0.17383 0.17383
Z3 z3-4.4.1 default unsat ✅ 0.89014 0.89248
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.84207 0.84106
Boolector SMT17 final boolector unsat ✅ 0.84723 0.84664
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.07519 6.54111
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.60461 0.60442
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.21371 1.21221
Q3B Q3B default unsat ✅ 0.81322 2.06000
STP stp_st default unsat ✅ 0.54491 0.54400
stp_mt default unsat ✅ 0.54273 0.53786
Yices2 Yices2-Main default unsat ✅ 0.16568 0.16564
Z3 z3-4.5.0 default unsat ✅ 0.43402 0.43421
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.76481 0.76470
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.78177 3.78186
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.60507 0.60597
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.22378 1.22376
Minkeyrink ST_st unsat ✅ 1.22351 1.22347
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.55498 0.55500
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.55288 0.55294
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.55351 0.55351
Yices2 Yices 2.6.0_default unsat ✅ 0.15760 0.15753
Z3 z3-4.7.1_default unsat ✅ 0.61013 0.61008
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.49922 1.49908
Poolector-wrapped-sq_default unsat ✅ 1.81781 6.73588
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.20488 1.20486
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.93390 3.93431
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.85465 0.85481
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.85465 0.85470
Par4 Par4-wrapped-sq_default unsat ✅ 0.16820 0.00633
STP STP-2019-wrapped-sq_default unsat ✅ 0.58995 0.59009
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.56034 0.56048
stp-minisat-wrapped-sq_default unsat ✅ 0.55383 0.55385
stp-mt-wrapped-sq_default unsat ✅ 0.56483 0.56494
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.56085 0.56098
stp-riss-wrapped-sq_default unsat ✅ 0.56272 0.56287
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.16564 0.16566
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.16526 0.16527
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.16561 0.16563
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.16344 0.16339
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.16496 0.16496
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.55984 0.55982
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.84407 1.84383
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.86051 2.86053
STP STP 2022.4_default unsat ✅ 0.57795 0.57776
STP 2022.4_default unsat ✅ 0.58086 0.58088
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 748.61800 855.69300
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.19983 0.19972
Z3-Owl z3-Owl-Final_default unsat ✅ 1.05690 1.05686
z3-Owl-Final_default unsat ✅ 1.16449 1.16428
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.10407 1.00415
cvc5 cvc5 unsat ✅ 1.81414 1.71442
SMTInterpol SMTInterpol unknown ❌ 1202.71924 1483.34942
STP STP unsat ✅ 29.03001 28.92828
Yices2 Yices2 unsat ✅ 0.34374 0.24400
Z3alpha Z3-alpha unsat ✅ 0.56474 0.46542