Benchmark

non-incremental/QF_BV/sage/app7/bench_512.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3250758
Compressed Size204345
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3250750
Compressed Size204349
Max. Term Depth12499
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1970 and1
=2627 let12332 extract1433 bvand33860
bvor22349 bvxor1740 bvadd35887 bvmul1
bvsub11674 bvult468 bvule505 bvslt210
bvsle121 bvshl11481 bvashr21776 zero_extend1155

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48446 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.48739 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.49560 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.49051 —
abziz_portfolio_2012_solvers default unsat ✅ 0.48779 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.48762 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.65570 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.78419 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.69331 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 172.79800 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.07200 —
CVC3-SMT-COMP-2012 default unsat ✅ 152.81500 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.79220 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.33414 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.97216 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.94470 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.20706 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.17353 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.84292 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.87562 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.07804 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.31785 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51183 —
STP2-SMT-COMP-2012 default unsat ✅ 0.48337 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.50792 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.52767 —
Z3-SMT-COMP-2011 default unsat ✅ 0.48757 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.94667 0.94586
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.25060 6.89795
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.26526 6.92795
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.68135 0.68090
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.97000
STP stp-cryptominisat4 default unsat ✅ 0.45634 0.45593
stp-cmsat4-v15 default unsat ✅ 0.45551 0.45493
stp-cmsat4-mt-v15 default unsat ✅ 0.45392 0.45293
stp-minisat-v15 default unsat ✅ 0.45510 0.45393
Yices2 Yices default unsat ✅ 0.18964 0.18897
Z3 z3 4.4.0 default unsat ✅ 0.67183 0.67190
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.83145 1.83230
ABC_glucose glucose unsat ✅ 1.82265 1.82383
Boolector Boolector boolector unsat ✅ 1.11164 1.11224
Boolector preprop boolector unsat ✅ 1.08755 1.08825
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.15304 6.74283
MapleSTP MapleSTP default unsat ✅ 0.43500 0.43524
MapleSTP-mt default unsat ✅ 0.44545 0.44567
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.62170 0.62309
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.61450 0.61478
Q3B Q3B default unsat ✅ 0.82496 2.03000
STP stp-cms-exp-2016 default unsat ✅ 0.44302 0.44323
stp-cms-mt-2016 default unsat ✅ 0.44935 0.44955
stp-cms-st-2016 default unsat ✅ 0.45686 0.45702
stp-minisat-st-2016 default unsat ✅ 0.45767 0.45791
Yices2 Yices-2.4.2 default unsat ✅ 0.18556 0.18560
Z3 z3-4.4.1 default unsat ✅ 0.49656 0.49807
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.88422 0.88106
Boolector SMT17 final boolector unsat ✅ 0.86683 0.86677
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.17628 6.71378
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.63976 0.63727
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.22933 1.22862
Q3B Q3B default unsat ✅ 0.81861 1.84000
STP stp_st default unsat ✅ 0.56553 0.56494
stp_mt default unsat ✅ 0.62572 0.62518
Yices2 Yices2-Main default unsat ✅ 0.18258 0.17587
Z3 z3-4.5.0 default unsat ✅ 0.66506 0.66425
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78296 0.78281
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.88793 3.88169
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.62865 0.62953
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.25002 1.25009
Minkeyrink ST_st unsat ✅ 1.25851 1.25787
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57057 0.57051
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.58265 0.58270
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.56767 0.56771
Yices2 Yices 2.6.0_default unsat ✅ 0.16840 0.16829
Z3 z3-4.7.1_default unsat ✅ 0.58378 0.58367
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.85305 1.85269
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.97019 2.97088
STP STP 2022.4_default unsat ✅ 0.58896 0.58893
STP 2022.4_default unsat ✅ 0.59417 0.59399
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 806.48000 914.44400
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.20675 0.20666
Z3-Owl z3-Owl-Final_default unsat ✅ 1.05245 1.05246
z3-Owl-Final_default unsat ✅ 1.06757 1.06781
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.25183 1.15159
cvc5 cvc5 unsat ✅ 2.16350 2.06287
SMTInterpol SMTInterpol unknown ❌ 1202.74823 1502.11601
STP STP unsat ✅ 31.23867 31.12489
Yices2 Yices2 unsat ✅ 0.35288 0.25260
Z3alpha Z3-alpha unsat ✅ 0.54142 0.44184
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.94346 0.81890
Bitwuzla-MachBV-base unsat ✅ 1.16094 1.03161
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.35446 1.22122
BVDecide bv_decide unknown ❌ 1201.39429 1201.00004
bv_decide-nokernel unknown ❌ 1201.39060 1201.01846
cvc5 cvc5 unsat ✅ 1.31694 1.17332
SMTInterpol SMTInterpol unknown ❌ 1201.89389 2196.16143
Yices2 Yices2 unsat ✅ 0.39528 0.26647
Z3alpha Z3-alpha unsat ✅ 0.96041 0.93992
Z3 Z3-alpha-base unsat ✅ 0.58942 0.46600
Z3-Owl-base unsat ✅ 1.68026 1.56117
z3siri-base unsat ✅ 0.55612 0.43995
Z3-Owl Z3-Owl unsat ✅ 1.14980 1.01771