Benchmark

non-incremental/QF_BV/Sage2/bench_878.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size86313
Compressed Size8013
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 86305
Compressed Size8038
Max. Term Depth94
Asserts 171
Declared Functions0
Declared Constants336
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not39 =170 let1583
bvor184 bvadd275 bvmul275 bvshl184
zero_extend626

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 2.01202 2.01124
Boolector SMT17 final boolector sat ✅ 21.22430 21.22270
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.83751 7.64008
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.73921 0.74002
MinkeyRink MinkeyRink 2017.3a default sat ✅ 4.52687 4.58104
Q3B Q3B default unknown ❌ 600.05500 1799.62000
STP stp_st default sat ✅ 2.79804 2.79733
stp_mt default sat ✅ 1.26962 4.03185
Yices2 Yices2-Main default sat ✅ 2.00292 2.00193
Z3 z3-4.5.0 default unknown ❌ 600.01000 599.89400
SMT-COMP 2018 Boolector Boolector_default sat ✅ 1.77183 1.77126
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 8.41722 8.41738
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.66609 0.66716
MinkeyRink Minkeyrink MT_mt sat ✅ 2.60591 9.25148
Minkeyrink ST_st sat ✅ 6.24127 6.24066
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.31725 0.31720
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.34554 0.48741
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.30840 1.30855
Yices2 Yices 2.6.0_default sat ✅ 1.95997 1.95983
Z3 z3-4.7.1_default sat ✅ 387.24300 387.25200
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.38878 0.38877
Poolector-wrapped-sq_default sat ✅ 0.58298 1.80000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 6.75824 6.74744
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 26.98310 26.97770
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 9.57865 36.73680
MinkeyRink ST-wrapped-sq_default sat ✅ 10.90200 10.90060
Par4 Par4-wrapped-sq_default sat ✅ 0.41040 0.00616
STP STP-2019-wrapped-sq_default sat ✅ 1.92917 1.92934
stp-mergesat-fixed-wrapped-sq_default sat ✅ 5.92006 5.92011
stp-minisat-wrapped-sq_default sat ✅ 0.71850 0.71856
stp-mt-wrapped-sq_default sat ✅ 3.11816 11.38780
stp-portfolio-fixed-wrapped-sq_default sat ✅ 6.01285 8.21942
stp-riss-wrapped-sq_default unknown ❌ 0.31335 0.31361
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.38581 0.38580
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 1.17095 1.17088
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 8.03213 8.03052
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 490.48900 490.45400
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.22917 0.22914
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1498.46000 1498.21000
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.41869 0.41862
Boolector Boolector-wrapped-sq_default sat ✅ 0.45372 0.45370
Poolector-wrapped-sq_default sat ✅ 0.58328 1.89000
CVC4 CVC4-sq-final_default sat ✅ 12.69470 12.69260
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.92000
MathSAT MathSAT5_default.sh sat ✅ 0.45774 0.45767
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.43985 0.44016
MinkeyRink Solver 2020.3_default sat ✅ 32.49420 127.44100
STP STP_default sat ✅ 0.73695 2.09198
STP ++ Mergsat v1_default sat ✅ 5.03791 5.03945
Yices2 Yices 2.6.2 bug fix_default sat ✅ 4.24144 4.24148
Z3 z3-4.8.8_default sat ✅ 49.87270 49.87360
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.38337 1.38323
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 24.34750 24.33860
STP STP 2022.4_default sat ✅ 1.16241 1.16241
STP 2022.4_default sat ✅ 1.16332 1.16315
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1249.25000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 2.10278 2.10279
Z3-Owl z3-Owl-Final_default sat ✅ 65.68310 65.67840
z3-Owl-Final_default sat ✅ 54.57760 54.57470
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 2.70756 2.60563
cvc5 cvc5 sat ✅ 12.79103 12.69115
SMTInterpol SMTInterpol unknown ❌ 1201.72151 1239.13423
STP STP sat ✅ 0.62484 0.52523
Yices2 Yices2 sat ✅ 3.72795 3.62799
Z3alpha Z3-alpha sat ✅ 176.38987 176.28831