Benchmark

non-incremental/QF_BV/sage/app7/bench_754.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3057616
Compressed Size192667
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3057608
Compressed Size192671
Max. Term Depth11780
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1863 and1
=2495 let11641 extract1351 bvand32052
bvor21129 bvxor1619 bvadd33924 bvmul1
bvsub10995 bvult447 bvule503 bvslt210
bvsle106 bvshl10814 bvashr20562 zero_extend1070

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.45754 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.69730 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.71014 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.70021 —
abziz_portfolio_2012_solvers default unsat ✅ 0.69676 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.69954 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.62384 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.74479 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.64965 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 334.18300 —
CVC3-SMT-COMP-2011 default unsat ✅ 280.09500 —
CVC3-SMT-COMP-2012 default unsat ✅ 291.88300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.61788 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.99728 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.91395 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.88098 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.16223 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.11753 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.79515 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.73170 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.81405 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.24290 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.48795 —
STP2-SMT-COMP-2012 default unsat ✅ 0.45941 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.47225 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.70881 —
Z3-SMT-COMP-2011 default unsat ✅ 0.69795 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.89070 0.88986
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.03495 6.54100
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.00938 6.51501
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.64458 0.64390
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.20000
STP stp-cryptominisat4 default unsat ✅ 0.42897 0.42793
stp-cmsat4-v15 default unsat ✅ 0.42899 0.42793
stp-cmsat4-mt-v15 default unsat ✅ 0.43021 0.42893
stp-minisat-v15 default unsat ✅ 0.42912 0.42793
Yices2 Yices default unsat ✅ 0.17101 0.16997
Z3 z3 4.4.0 default unsat ✅ 0.51960 0.51992
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.72122 1.72239
ABC_glucose glucose unsat ✅ 1.78042 1.78211
Boolector Boolector boolector unsat ✅ 0.97553 0.97604
Boolector preprop boolector unsat ✅ 0.95974 0.95852
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.94297 6.41720
MapleSTP MapleSTP default unsat ✅ 0.41030 0.41032
MapleSTP-mt default unsat ✅ 0.42050 0.42018
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.58732 0.58876
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.57835 0.57865
Q3B Q3B default unsat ✅ 0.78240 2.02000
STP stp-cms-exp-2016 default unsat ✅ 0.41737 0.41759
stp-cms-mt-2016 default unsat ✅ 0.42413 0.42431
stp-cms-st-2016 default unsat ✅ 0.43293 0.43262
stp-minisat-st-2016 default unsat ✅ 0.42480 0.42498
Yices2 Yices-2.4.2 default unsat ✅ 0.16890 0.16895
Z3 z3-4.4.1 default unsat ✅ 0.40663 0.40853
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.81442 0.81357
Boolector SMT17 final boolector unsat ✅ 0.88007 0.87902
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.17928 6.74307
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.63501 0.63492
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.18752 1.18704
Q3B Q3B default unsat ✅ 0.74926 1.82000
STP stp_st default unsat ✅ 0.54460 0.54408
stp_mt default unsat ✅ 0.56806 0.56742
Yices2 Yices2-Main default unsat ✅ 0.16037 0.15975
Z3 z3-4.5.0 default unsat ✅ 0.59164 0.59156
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.74540 0.74532
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.61682 3.61711
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.58618 0.58722
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.18285 1.18269
Minkeyrink ST_st unsat ✅ 1.18455 1.18458
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.53691 0.53695
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.53368 0.53368
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.53295 0.53296
Yices2 Yices 2.6.0_default unsat ✅ 0.15225 0.15215
Z3 z3-4.7.1_default unsat ✅ 0.53157 0.53148
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.12354 1.12350
Boolector Boolector-wrapped-sq_default unsat ✅ 1.41945 1.41926
Poolector-wrapped-sq_default unsat ✅ 1.67828 6.19000
CVC4 CVC4-sq-final_default unsat ✅ 4.92259 4.92224
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.73704 0.73695
MathSAT MathSAT5_default.sh unsat ✅ 0.60060 0.60052
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.68999 0.69002
MinkeyRink Solver 2020.3_default unsat ✅ 0.71329 0.71341
STP STP_default unsat ✅ 0.50092 0.50105
STP ++ Mergsat v1_default unsat ✅ 0.49677 0.49847
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.19528 0.19518
Z3 z3-4.8.8_default unsat ✅ 0.47512 0.47505
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.13108 1.13099
MathSAT mathsat-5.6.6_default unsat ✅ 0.61746 0.61744
STP STP 2021.0_default unsat ✅ 0.51647 0.51659
Z3 z3-4.8.11_default unsat ✅ 0.38240 0.38235
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.11565 1.01477
cvc5 cvc5 unsat ✅ 0.84558 0.74573
SMTInterpol SMTInterpol unknown ❌ 1202.74423 1438.00188
STP STP unsat ✅ 27.07674 26.96515
Yices2 Yices2 unsat ✅ 0.33606 0.23616
Z3alpha Z3-alpha unsat ✅ 0.54384 0.44405