Benchmark

non-incremental/QF_BV/Sage2/bench_2465.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size20872
Compressed Size1921
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 20864
Compressed Size1915
Max. Term Depth60
Asserts 114
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not90 =94 let412
bvadd78 bvmul78 bvult19 zero_extend166

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 32.27990 32.26990
Boolector SMT17 final boolector sat ✅ 24.88460 24.88080
CVC4 CVC4-smtcomp2017-main default sat ✅ 327.51300 657.37300
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 12.06030 12.06060
MinkeyRink MinkeyRink 2017.3a default sat ✅ 8.41255 11.72000
Q3B Q3B default unknown ❌ 600.08200 1799.58000
STP stp_st default sat ✅ 5.26516 5.26522
stp_mt default sat ✅ 9.72331 38.10680
Yices2 Yices2-Main default sat ✅ 101.93300 60.44660
Z3 z3-4.5.0 default unknown ❌ 600.10900 600.05400
SMT-COMP 2018 Boolector Boolector_default sat ✅ 24.82550 24.82490
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.29932 3.29931
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 8.96944 8.96925
MinkeyRink Minkeyrink MT_mt sat ✅ 1.08404 3.98065
Minkeyrink ST_st sat ✅ 2.09933 2.09918
STP STP-CMS-st-2018_default-no-stderr sat ✅ 4.51844 4.51814
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.51962 13.52270
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.34186 1.34140
Yices2 Yices 2.6.0_default sat ✅ 36.63010 36.62560
Z3 z3-4.7.1_default sat ✅ 760.37900 760.39800
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 4.75062 4.75056
Poolector-wrapped-sq_default sat ✅ 5.33440 20.65000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 55.32990 55.32840
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 18.97530 18.96650
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 1.08311 4.02415
MinkeyRink ST-wrapped-sq_default sat ✅ 10.00000 10.00020
Par4 Par4-wrapped-sq_default sat ✅ 31.91220 95.57000
STP STP-2019-wrapped-sq_default sat ✅ 4.68968 4.68973
stp-mergesat-fixed-wrapped-sq_default sat ✅ 12.27790 12.27840
stp-minisat-wrapped-sq_default sat ✅ 12.96490 12.96440
stp-mt-wrapped-sq_default sat ✅ 1.09311 3.85704
stp-portfolio-fixed-wrapped-sq_default sat ✅ 13.26160 30.02600
stp-riss-wrapped-sq_default unknown ❌ 0.15221 0.15238
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 30.30640 30.30670
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 4.82804 4.82713
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 8.02205 8.02185
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.94000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 9.04003 9.03876
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 11.49250 11.49170
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 16.14740 16.14710
Boolector Boolector-wrapped-sq_default sat ✅ 13.28970 13.28690
Poolector-wrapped-sq_default sat ✅ 14.52710 56.71790
CVC4 CVC4-sq-final_default sat ✅ 114.82900 114.81800
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.11000 1200.04000
MathSAT MathSAT5_default.sh sat ✅ 27.18380 27.18400
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08645 0.08672
MinkeyRink Solver 2020.3_default sat ✅ 2.33659 8.97518
STP STP_default sat ✅ 1.61003 6.13348
STP ++ Mergsat v1_default sat ✅ 0.67401 0.67566
Yices2 Yices 2.6.2 bug fix_default sat ✅ 2.35388 2.35383
Z3 z3-4.8.8_default sat ✅ 186.56400 186.56600
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 3.65230 3.65078
Bitwuzla-wrapped_default sat ✅ 22.53800 22.53900
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 3.49336 3.49356
MathSAT MathSAT-5.6.8_default sat ✅ 5.25662 5.25573
STP STP 2022.4_default sat ✅ 1.09659 1.09660
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 3.51550 3.51480
Z3++BV z3++bv_0702_default sat ✅ 18.04820 18.04250
Z3 z3-4.8.17_default sat ✅ 136.49200 136.48000
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 21.68600 21.67490
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 7.52384 7.52452
STP STP 2022.4_default sat ✅ 1.03379 1.03385
STP 2022.4_default sat ✅ 1.02888 1.02879
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1234.13000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 364.33900 364.34300
Z3-Owl z3-Owl-Final_default sat ✅ 347.95000 347.90200
z3-Owl-Final_default sat ✅ 73.37960 73.38300