Benchmark

non-incremental/QF_BV/Sage2/bench_349.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size34848
Compressed Size1256
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 34840
Compressed Size1246
Max. Term Depth78
Asserts 13
Declared Functions0
Declared Constants34
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not4 =6 let807
bvadd394 bvmul30 bvult1 bvule2
bvuge2 bvsge1 bvlshr2 zero_extend377

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.06100 0.06003
Boolector SMT17 final boolector unsat ✅ 0.06033 0.05997
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.07814 0.12817
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.13868 0.13841
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.02275 0.01526
Q3B Q3B default unsat ✅ 8.45003 24.84000
STP stp_st default unsat ✅ 0.11203 0.11167
stp_mt default unsat ✅ 0.12107 0.27030
Yices2 Yices2-Main default unsat ✅ 0.00813 0.00661
Z3 z3-4.5.0 default unsat ✅ 0.70075 0.70085
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.02839 0.02829
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.14798 0.14811
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.13859 0.13967
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.01519 0.01523
Minkeyrink ST_st unsat ✅ 0.01451 0.01458
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.06391 0.06410
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.07228 0.09766
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.19682 0.19691
Yices2 Yices 2.6.0_default unsat ✅ 0.01117 0.00904
Z3 z3-4.7.1_default unsat ✅ 4.09068 4.09007
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.07421 0.07425
Poolector-wrapped-sq_default unsat ✅ 0.17558 0.21150
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.02001 0.02003
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.07350 0.07373
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.01882 0.01895
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.01725 0.01735
Par4 Par4-wrapped-sq_default unsat ✅ 0.01672 0.00578
STP STP-2019-wrapped-sq_default unsat ✅ 0.07181 0.07216
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.07292 0.07318
stp-minisat-wrapped-sq_default unsat ✅ 0.06961 0.06978
stp-mt-wrapped-sq_default unsat ✅ 0.08018 0.09616
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.10647 0.14099
stp-riss-wrapped-sq_default unknown ❌ 0.06736 0.06756
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.00973 0.00979
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.01201 0.01202
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01158 0.01160
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.04000 2400.01000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.01097 0.01100
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.30800 1.30789
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.08093 0.08091
Boolector Boolector-wrapped-sq_default unsat ✅ 0.07503 0.07505
Poolector-wrapped-sq_default unsat ✅ 0.17895 0.21256
CVC4 CVC4-sq-final_default unsat ✅ 2.31669 2.31691
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.28717 0.28714
MathSAT MathSAT5_default.sh unsat ✅ 0.06420 0.06412
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.01641 0.01652
MinkeyRink Solver 2020.3_default unsat ✅ 0.02616 0.01746
STP STP_default unsat ✅ 0.05368 0.07305
STP ++ Mergsat v1_default unsat ✅ 0.05335 0.05459
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.02118 0.00902
Z3 z3-4.8.8_default unsat ✅ 2.36839 2.36825
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.04536 0.04533
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.22771 0.22824
STP STP 2022.4_default unsat ✅ 0.01306 0.01311
STP 2022.4_default unsat ✅ 0.01323 0.01324
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 4.72403 13.39740
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.01035 0.00793
Z3-Owl z3-Owl-Final_default unsat ✅ 8.98571 8.98554
z3-Owl-Final_default unsat ✅ 10.34030 10.33990