Benchmark

non-incremental/QF_BV/sage/app2/bench_480.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size358342
Compressed Size44857
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 358334
Compressed Size44867
Max. Term Depth892
Asserts 1
Declared Functions0
Declared Constants1366
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true39 ite1 not264 and1
=438 let870 extract167 bvand1825
bvor73 bvxor60 bvadd3761 bvmul23
bvsub2427 bvsdiv22 bvult133 bvule251
bvslt167 bvsle70 bvshl2244 bvashr1155
zero_extend1508

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.04750 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.06881 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.06665 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.06525 —
abziz_portfolio_2012_solvers default unsat ✅ 0.06448 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.06306 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.04820 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.07015 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.05165 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.28198 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.26629 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.25132 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ 221.79800 —
CVC4-SMT-EVAL-2013 default unknown ❌ 862.91900 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.12314 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.11399 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 3.24847 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.14227 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.44312 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.06145 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.43239 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.39522 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.26017 —
STP2-SMT-COMP-2012 default unsat ✅ 0.04745 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.04897 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.05415 —
Z3-SMT-COMP-2011 default unsat ✅ 0.05904 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.07392 0.07353
Boolector SMT17 final boolector unsat ✅ 0.08207 0.08026
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.59580 7.01452
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.09189 0.09196
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.19622 0.19469
Q3B Q3B default unsat ✅ 0.43080 1.01275
STP stp_st default unsat ✅ 0.15391 0.15390
stp_mt default unsat ✅ 0.15274 0.15272
Yices2 Yices2-Main default unsat ✅ 0.03310 0.03235
Z3 z3-4.5.0 default unsat ✅ 0.10973 0.10878
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07846 0.07834
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.01498 2.01489
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.08981 0.09087
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.19998 0.19996
Minkeyrink ST_st unsat ✅ 0.20026 0.20027
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.05301 0.05310
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.05321 0.05328
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.05326 0.05330
Yices2 Yices 2.6.0_default unsat ✅ 0.03302 0.03290
Z3 z3-4.7.1_default unsat ✅ 0.20680 0.20671
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11167 0.11164
Boolector Boolector-wrapped-sq_default unsat ✅ 0.13531 0.13530
Poolector-wrapped-sq_default unsat ✅ 0.27681 0.68971
CVC4 CVC4-sq-final_default unsat ✅ 1.67874 1.67881
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 32.32130 32.31760
MathSAT MathSAT5_default.sh unsat ✅ 0.09368 0.09364
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.23899 0.23889
MinkeyRink Solver 2020.3_default unsat ✅ 0.25015 0.25027
STP STP_default unsat ✅ 0.05582 0.05590
STP ++ Mergsat v1_default unsat ✅ 0.04986 0.05152
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.03626 0.03623
Z3 z3-4.8.8_default unsat ✅ 0.06013 0.06005
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11325 0.11321
Bitwuzla-wrapped_default unsat ✅ 0.11490 0.11488
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.03640 2.03690
MathSAT MathSAT-5.6.8_default unsat ✅ 3.91887 3.91860
STP STP 2022.4_default unsat ✅ 0.05408 0.05414
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.03870 0.03862
Z3++BV z3++bv_0702_default unsat ✅ 26.97460 26.97360
Z3 z3-4.8.17_default unsat ✅ 0.14568 0.14744
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.16820 0.16713
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.04510 2.04522
STP STP 2022.4_default unsat ✅ 0.05372 0.05374
STP 2022.4_default unsat ✅ 0.05436 0.05441
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 12.25150 34.60130
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03660 0.03657
Z3-Owl z3-Owl-Final_default unsat ✅ 0.90610 0.90607
z3-Owl-Final_default unsat ✅ 0.93770 0.91752
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.31561 0.19847
Bitwuzla-MachBV-base unsat ✅ 0.35177 0.22643
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.39468 0.27561
BVDecide bv_decide unsat ✅ 461.34286 461.06496
bv_decide-nokernel unsat ✅ 286.76369 286.51913
cvc5 cvc5 unsat ✅ 1.53737 1.42200
SMTInterpol SMTInterpol unsat ✅ 29.71064 57.41892
Yices2 Yices2 unsat ✅ 0.28180 0.16148
Z3alpha Z3-alpha unsat ✅ 0.43758 0.31954
Z3 Z3-alpha-base unsat ✅ 0.54971 0.42140
Z3-Owl-base unsat ✅ 1.85107 1.72475
z3siri-base unsat ✅ 0.52782 0.40731
Z3-Owl Z3-Owl unsat ✅ 0.91957 0.78618