Benchmark

non-incremental/QF_BV/sage/app7/bench_272.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3306878
Compressed Size208353
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3306870
Compressed Size208332
Max. Term Depth12678
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2114 and1
=2799 let12573 extract1547 bvand34092
bvor22404 bvxor1957 bvadd36530 bvmul2
bvsub11905 bvsdiv5 bvult487 bvule526
bvslt212 bvsle121 bvshl11680 bvashr21963
zero_extend1310

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.50175 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.53874 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.54405 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.53985 —
abziz_portfolio_2012_solvers default unsat ✅ 0.53650 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.54078 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66062 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79924 —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 173.62100 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.79200 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.51600 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.83245 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.50281 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.98964 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.95967 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23261 —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87107 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.96745 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.15121 —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52267 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49142 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.52358 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.58469 —
Z3-SMT-COMP-2011 default unsat ✅ 0.53884 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.89278 0.89020
Boolector SMT17 final boolector unsat ✅ 0.89336 0.88917
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.38426 7.06324
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.64044 0.63907
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.29033 1.28994
Q3B Q3B default unsat ✅ 0.98760 2.16000
STP stp_st default unsat ✅ 0.64454 0.63510
stp_mt default unsat ✅ 0.55876 0.55750
Yices2 Yices2-Main default unsat ✅ 0.57819 0.36979
Z3 z3-4.5.0 default unsat ✅ 0.91068 0.57213
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.79097 0.78992
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.95587 3.95505
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.64298 0.64372
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.27610 1.27611
Minkeyrink ST_st unsat ✅ 1.26775 1.26626
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57866 0.57848
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.58139 0.57970
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57423 0.57420
Yices2 Yices 2.6.0_default unsat ✅ 0.36475 0.36466
Z3 z3-4.7.1_default unsat ✅ 0.53969 0.53957
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.49226 1.49220
Poolector-wrapped-sq_default unsat ✅ 1.79497 6.69405
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.21073 1.21054
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.11244 4.11209
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.88888 0.88897
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.89153 0.89152
Par4 Par4-wrapped-sq_default unsat ✅ 0.37733 0.00499
STP STP-2019-wrapped-sq_default unsat ✅ 0.58864 0.58870
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.58081 0.58070
stp-minisat-wrapped-sq_default unsat ✅ 0.58617 0.58625
stp-mt-wrapped-sq_default unsat ✅ 0.58554 0.58564
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.57987 0.58000
stp-riss-wrapped-sq_default unsat ✅ 0.58800 0.58816
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.34318 0.34298
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.34652 0.34654
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.34268 0.34268
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.33553 0.33555
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.33983 0.33979
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.56410 0.56411
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.26740 1.26399
Bitwuzla-wrapped_default unsat ✅ 1.31654 1.31641
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.16635 4.16412
MathSAT MathSAT-5.6.8_default unsat ✅ 0.67316 0.67308
STP STP 2022.4_default unsat ✅ 0.59799 0.59798
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.36925 0.36919
Z3++BV z3++bv_0702_default unsat ✅ 0.73909 0.73901
Z3 z3-4.8.17_default unsat ✅ 0.65586 0.65766
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.33965 1.23968
cvc5 cvc5 unsat ✅ 2.11136 2.01167
SMTInterpol SMTInterpol unknown ❌ 1202.74447 1360.14639
STP STP unsat ✅ 34.10960 34.00877
Yices2 Yices2 unsat ✅ 0.45803 0.35826
Z3alpha Z3-alpha unsat ✅ 0.54009 0.44065
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.96187 0.83401
Bitwuzla-MachBV-base unsat ✅ 1.18535 1.06270
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.39913 1.27036
BVDecide bv_decide unknown ❌ 1201.34934 1201.01457
bv_decide-nokernel unknown ❌ 1201.37171 1200.98384
cvc5 cvc5 unsat ✅ 1.29495 1.17467
SMTInterpol SMTInterpol unknown ❌ 1201.86006 2174.40332
Yices2 Yices2 unsat ✅ 0.46431 0.34749
Z3alpha Z3-alpha unsat ✅ 0.98104 0.96798
Z3 Z3-alpha-base unsat ✅ 0.56250 0.44372
Z3-Owl-base unsat ✅ 1.75741 1.64018
z3siri-base unsat ✅ 0.59452 0.47407
Z3-Owl Z3-Owl unsat ✅ 1.08383 0.96735