Benchmark

non-incremental/QF_BV/sage/app7/bench_1703.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4412348
Compressed Size272726
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4412340
Compressed Size272730
Max. Term Depth16833
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2681 and1
=3459 let16714 extract1712 bvand45661
bvor30096 bvxor2276 bvadd49024 bvmul7
bvsub16090 bvsdiv20 bvult604 bvule628
bvslt219 bvsle124 bvshl15779 bvashr29803
zero_extend1515

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.70497 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.69647 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.69185 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.70486 —
abziz_portfolio_2012_solvers default unsat ✅ 0.70486 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.69510 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.94399 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.06312 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.99493 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 423.10300 —
CVC3-SMT-COMP-2011 default unsat ✅ 354.98000 —
CVC3-SMT-COMP-2012 default unsat ✅ 369.96500 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.63748 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.53591 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.30295 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.25930 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.63887 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.60154 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.14385 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.53036 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.17445 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.85881 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.73788 —
STP2-SMT-COMP-2012 default unsat ✅ 0.70855 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.77120 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.76845 —
Z3-SMT-COMP-2011 default unsat ✅ 0.69014 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.14913 1.14821
Boolector SMT17 final boolector unsat ✅ 1.22259 1.22213
CVC4 CVC4-smtcomp2017-main default unsat ✅ 6.02993 9.61373
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.92357 0.92374
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.67064 1.67082
Q3B Q3B default unsat ✅ 1.14042 2.99000
STP stp_st default unsat ✅ 0.86564 0.86301
stp_mt default unsat ✅ 0.80491 0.80313
Yices2 Yices2-Main default unsat ✅ 0.48275 0.48177
Z3 z3-4.5.0 default unsat ✅ 0.83895 0.83874
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.04260 1.04243
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.31306 5.31282
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83139 0.83232
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.73932 1.73918
Minkeyrink ST_st unsat ✅ 1.69250 1.69257
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.81299 0.81299
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.82176 0.82179
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.81830 0.81838
Yices2 Yices 2.6.0_default unsat ✅ 0.47816 0.47804
Z3 z3-4.7.1_default unsat ✅ 1.00849 1.00833
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.02885 2.02880
Poolector-wrapped-sq_default unsat ✅ 2.31787 8.80000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.63219 1.63202
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.54073 5.54064
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.14424 1.14437
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.14275 1.14268
Par4 Par4-wrapped-sq_default unsat ✅ 0.48865 0.00608
STP STP-2019-wrapped-sq_default unsat ✅ 0.82858 0.82869
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.81460 0.81467
stp-minisat-wrapped-sq_default unsat ✅ 0.82693 0.82700
stp-mt-wrapped-sq_default unsat ✅ 0.82517 0.82532
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.81485 0.81490
stp-riss-wrapped-sq_default unsat ✅ 0.82888 0.82890
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.44795 0.44794
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.44865 0.44862
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.44562 0.44558
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.44173 0.44172
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.44768 0.44767
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.99329 0.99326
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.66619 1.66608
Boolector Boolector-wrapped-sq_default unsat ✅ 2.00419 2.00412
Poolector-wrapped-sq_default unsat ✅ 2.38404 8.87000
CVC4 CVC4-sq-final_default unsat ✅ 7.23421 7.23396
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.04813 1.04805
MathSAT MathSAT5_default.sh unsat ✅ 0.85377 0.85378
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.94711 0.94724
MinkeyRink Solver 2020.3_default unsat ✅ 0.98076 0.98092
STP STP_default unsat ✅ 0.77868 0.77878
STP ++ Mergsat v1_default unsat ✅ 0.82912 0.82838
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.49920 0.49905
Z3 z3-4.8.8_default unsat ✅ 0.78355 0.78351
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.52693 2.52475
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.21545 4.21523
STP STP 2022.4_default unsat ✅ 0.83218 0.83215
STP 2022.4_default unsat ✅ 0.84606 0.84603
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.11000 1340.93000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.48461 0.48459
Z3-Owl z3-Owl-Final_default unsat ✅ 1.63132 1.62817
z3-Owl-Final_default unsat ✅ 1.54043 1.54057
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.41441 1.31471
cvc5 cvc5 unsat ✅ 1.98118 1.88067
SMTInterpol SMTInterpol unknown ❌ 1202.72346 1422.69535
STP STP unsat ✅ 65.81398 65.70383
Yices2 Yices2 unsat ✅ 0.55441 0.45444
Z3alpha Z3-alpha unsat ✅ 0.62322 0.52368