Benchmark

non-incremental/QF_BV/sage/app7/bench_5692.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3511784
Compressed Size226224
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3511776
Compressed Size226230
Max. Term Depth13656
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2449 and1
=3187 let13433 extract1685 bvand35776
bvor23462 bvxor2219 bvadd38770 bvmul7
bvsub12623 bvsdiv19 bvult591 bvule626
bvslt219 bvsle124 bvshl12321 bvashr23094
zero_extend1489

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.52260 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.52176 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.52107 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.52347 —
abziz_portfolio_2012_solvers default unsat ✅ 0.52091 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.52427 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.69720 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.83888 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.74520 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ — —
CVC3-SMT-COMP-2011 default unsat ✅ 146.95600 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.33100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.07613 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.73486 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.04819 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.00883 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.30495 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.27195 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.91769 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.38981 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.45648 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.42315 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.55124 —
STP2-SMT-COMP-2012 default unsat ✅ 0.52276 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.55894 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.56203 —
Z3-SMT-COMP-2011 default unsat ✅ 0.51976 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.98556 0.98273
Boolector SMT17 final boolector unsat ✅ 0.92535 0.92535
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.45804 7.15107
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.72554 0.72413
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.35772 1.35730
Q3B Q3B default unsat ✅ 0.91258 2.38000
STP stp_st default unsat ✅ 0.60847 0.60655
stp_mt default unsat ✅ 0.66957 0.66891
Yices2 Yices2-Main default unsat ✅ 0.39417 0.39349
Z3 z3-4.5.0 default unsat ✅ 0.74189 0.74121
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.81842 0.81840
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.20527 4.20336
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.71081 0.71191
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.34227 1.34233
Minkeyrink ST_st unsat ✅ 1.34582 1.34583
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.60084 0.60060
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.60235 0.60243
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.61559 0.61548
Yices2 Yices 2.6.0_default unsat ✅ 0.39164 0.39157
Z3 z3-4.7.1_default unsat ✅ 0.64321 0.64306
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.57592 1.57593
Poolector-wrapped-sq_default unsat ✅ 1.89398 13.97860
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.26881 1.26854
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.41015 4.41043
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.93990 0.93999
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.93712 0.93724
Par4 Par4-wrapped-sq_default unsat ✅ 0.41066 0.00618
STP STP-2019-wrapped-sq_default unsat ✅ 0.62345 0.62364
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.62252 0.62261
stp-minisat-wrapped-sq_default unsat ✅ 0.62068 0.62077
stp-mt-wrapped-sq_default unsat ✅ 0.62137 0.62135
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.61761 0.61774
stp-riss-wrapped-sq_default unsat ✅ 0.62515 0.62527
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.36821 0.36818
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.36824 0.36822
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.37195 0.37183
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.36794 0.36799
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.36678 0.36671
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.79787 0.79782
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.30496 1.30488
MathSAT mathsat-5.6.6_default unsat ✅ 0.69994 0.69993
STP STP 2021.0_default unsat ✅ 0.59747 0.59753
Z3 z3-4.8.11_default unsat ✅ 0.76473 0.76470
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.30555 1.30541
Bitwuzla-wrapped_default unsat ✅ 1.38597 1.38560
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.55253 4.55232
MathSAT MathSAT-5.6.8_default unsat ✅ 0.71189 0.71170
STP STP 2022.4_default unsat ✅ 0.64454 0.64448
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.40024 0.40023
Z3++BV z3++bv_0702_default unsat ✅ 0.72772 0.72769
Z3 z3-4.8.17_default unsat ✅ 0.66472 0.66329
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.02669 2.02628
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.25881 3.25868
STP STP 2022.4_default unsat ✅ 0.64598 0.64584
STP 2022.4_default unsat ✅ 0.63637 0.63634
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.08000 1311.92000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.39838 0.39826
Z3-Owl z3-Owl-Final_default unsat ✅ 1.06008 1.05984
z3-Owl-Final_default unsat ✅ 1.07840 1.07862
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.45986 1.35994
cvc5 cvc5 unsat ✅ 1.80565 1.70583
SMTInterpol SMTInterpol unknown ❌ 1202.72003 1406.91670
STP STP unsat ✅ 39.86130 39.74242
Yices2 Yices2 unsat ✅ 0.58427 0.48492
Z3alpha Z3-alpha unsat ✅ 0.58762 0.48810