Benchmark

non-incremental/QF_BV/sage/app7/bench_3914.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3670791
Compressed Size235057
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3670783
Compressed Size235045
Max. Term Depth14115
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2517 and1
=3286 let13938 extract1705 bvand37335
bvor24545 bvxor2273 bvadd40533 bvmul7
bvsub13390 bvsdiv19 bvult604 bvule626
bvslt219 bvsle124 bvshl13084 bvashr24328
zero_extend1509

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.54402 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.58788 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.59229 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.59863 —
abziz_portfolio_2012_solvers default unsat ✅ 0.59550 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.59133 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.72551 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.87946 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.77107 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 174.88000 —
CVC3-SMT-COMP-2011 default unsat ✅ 147.88800 —
CVC3-SMT-COMP-2012 default unsat ✅ 154.61800 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.19561 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.87952 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.09479 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.05383 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.37673 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.32558 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.95349 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.84119 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.69431 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.49620 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.62433 —
STP2-SMT-COMP-2012 default unsat ✅ 0.54902 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.58764 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.64753 —
Z3-SMT-COMP-2011 default unsat ✅ 0.58747 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.96725 0.96493
Boolector SMT17 final boolector unsat ✅ 0.95978 0.95898
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.68949 7.55206
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.71051 0.71078
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.39679 1.39569
Q3B Q3B default unsat ✅ 1.03826 2.61000
STP stp_st default unsat ✅ 0.62749 0.62745
stp_mt default unsat ✅ 0.66605 0.66456
Yices2 Yices2-Main default unsat ✅ 0.39655 0.39642
Z3 z3-4.5.0 default unsat ✅ 0.76355 0.76269
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.86279 0.86268
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.47537 4.47549
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.69860 0.69951
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.41530 1.41534
Minkeyrink ST_st unsat ✅ 1.41491 1.41476
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.63914 0.63912
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.63925 0.63928
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.64076 0.64085
Yices2 Yices 2.6.0_default unsat ✅ 0.39665 0.39654
Z3 z3-4.7.1_default unsat ✅ 0.84152 0.84141
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.63169 1.63177
Poolector-wrapped-sq_default unsat ✅ 1.91169 7.07000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.34351 1.34205
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.60619 4.60619
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.98028 0.98040
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.99031 0.99041
Par4 Par4-wrapped-sq_default unsat ✅ 0.41018 0.00600
STP STP-2019-wrapped-sq_default unsat ✅ 0.65472 0.65485
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.64618 0.64631
stp-minisat-wrapped-sq_default unsat ✅ 0.65405 0.65416
stp-mt-wrapped-sq_default unsat ✅ 0.66309 0.66321
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.64683 0.64694
stp-riss-wrapped-sq_default unsat ✅ 0.66009 0.65974
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.37454 0.37429
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.37507 0.37504
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.37102 0.37097
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.36959 0.36936
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.37122 0.37120
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.57418 0.57372
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.16552 2.16535
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.51822 3.51875
STP STP 2022.4_default unsat ✅ 0.70196 0.70198
STP 2022.4_default unsat ✅ 0.70551 0.70533
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1318.14000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.40540 0.40535
Z3-Owl z3-Owl-Final_default unsat ✅ 1.09878 1.09880
z3-Owl-Final_default unsat ✅ 1.09594 1.09606
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.28678 1.18685
cvc5 cvc5 unsat ✅ 1.73037 1.63054
SMTInterpol SMTInterpol unknown ❌ 1202.74957 1418.53875
STP STP unsat ✅ 47.18431 47.08306
Yices2 Yices2 unsat ✅ 0.54765 0.44779
Z3alpha Z3-alpha unsat ✅ 0.56571 0.46528