Benchmark

non-incremental/QF_BV/Sage2/bench_2840.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size22247
Compressed Size2089
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 22239
Compressed Size2104
Max. Term Depth60
Asserts 127
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not103 =107 let438
bvadd78 bvmul78 bvult19 zero_extend179

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 91.86830 91.85000
Boolector SMT17 final boolector sat ✅ 129.96900 129.97300
CVC4 CVC4-smtcomp2017-main default sat ✅ 59.72230 119.84300
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 34.72520 34.72100
MinkeyRink MinkeyRink 2017.3a default sat ✅ 8.55755 12.15000
Q3B Q3B default unknown ❌ 600.04800 1790.17000
STP stp_st default sat ✅ 0.74432 0.73261
stp_mt default sat ✅ 0.78792 2.61848
Yices2 Yices2-Main default sat ✅ 1.88163 1.88095
Z3 z3-4.5.0 default sat ✅ 431.71700 431.65800
SMT-COMP 2018 Boolector Boolector_default sat ✅ 95.39460 95.38490
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 20.60610 20.60600
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 20.99960 20.99910
MinkeyRink Minkeyrink MT_mt sat ✅ 2.78325 10.74900
Minkeyrink ST_st sat ✅ 9.12649 9.12524
STP STP-CMS-st-2018_default-no-stderr sat ✅ 2.20524 2.20521
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.20187 4.25973
STP-Riss-st-2018_riss-no-stderr sat ✅ 3.38144 3.38122
Yices2 Yices 2.6.0_default sat ✅ 50.64080 50.63600
Z3 z3-4.7.1_default sat ✅ 25.87530 25.87400
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 21.02390 21.02400
Poolector-wrapped-sq_default sat ✅ 22.39940 88.42000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 113.55800 113.55000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 278.44700 278.39800
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 2.18463 8.39700
MinkeyRink ST-wrapped-sq_default sat ✅ 7.43245 7.43300
Par4 Par4-wrapped-sq_default sat ✅ 79.78960 239.18000
STP STP-2019-wrapped-sq_default sat ✅ 16.50100 16.50100
stp-mergesat-fixed-wrapped-sq_default sat ✅ 17.09110 17.07910
stp-minisat-wrapped-sq_default sat ✅ 4.35225 4.35271
stp-mt-wrapped-sq_default sat ✅ 2.05451 7.66461
stp-portfolio-fixed-wrapped-sq_default sat ✅ 17.34970 38.71050
stp-riss-wrapped-sq_default unknown ❌ 0.15538 0.15558
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 450.63500 450.59000
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 2.44474 2.44467
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 34.21040 34.20880
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.57000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 98.03590 98.03690
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 26.69050 26.69040
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 12.51580 12.51040
MathSAT mathsat-5.6.6_default sat ✅ 136.49100 136.46900
STP STP 2021.0_default sat ✅ 1.69504 6.43518
Z3 z3-4.8.11_default sat ✅ 556.47300 556.40900
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 11.04050 11.03790
Bitwuzla-wrapped_default sat ✅ 16.11460 16.11010
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 306.89100 306.89800
MathSAT MathSAT-5.6.8_default sat ✅ 198.49100 198.46000
STP STP 2022.4_default sat ✅ 0.69217 0.69219
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 51.03690 51.03690
Z3++BV z3++bv_0702_default sat ✅ 16.39520 16.39590
Z3 z3-4.8.17_default sat ✅ 211.48500 211.45400
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 17.66610 17.66500
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 115.28100 115.27500
STP STP 2022.4_default sat ✅ 3.12949 3.12934
STP 2022.4_default sat ✅ 3.13534 3.13540
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1234.34000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 68.49940 68.49500
Z3-Owl z3-Owl-Final_default sat ✅ 30.47710 30.47630
z3-Owl-Final_default sat ✅ 41.67760 41.67130
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 27.18837 27.08714
cvc5 cvc5 sat ✅ 48.78119 48.68076
SMTInterpol SMTInterpol unknown ❌ 1201.71825 1220.38524
STP STP sat ✅ 54.43597 54.31594
Yices2 Yices2 sat ✅ 28.99078 28.87891
Z3alpha Z3-alpha sat ✅ 39.14658 39.04544