Benchmark

non-incremental/QF_BV/Sage2/bench_11885.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size134617
Compressed Size12488
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 134609
Compressed Size12460
Max. Term Depth27
Asserts 456
Declared Functions0
Declared Constants206
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not87 =164 let2419
extract25 bvand28 bvor124 bvadd1047
bvmul629 bvult18 bvule72 bvugt33
bvuge103 bvslt3 bvsle30 bvsgt11
bvsge21 bvshl161 bvlshr27 bvashr14
zero_extend277

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.19892 0.19707
Boolector SMT17 final boolector unsat ✅ 0.36813 0.36536
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.72765 1.37749
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 2.33053 2.31665
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.36737 0.36554
Q3B Q3B default unknown ❌ 246.00400 490.91200
STP stp_st default unsat ✅ 14.20970 14.20750
stp_mt default unsat ✅ 8.96886 26.83100
Yices2 Yices2-Main default unsat ✅ 0.03477 0.03218
Z3 z3-4.5.0 default unsat ✅ 3.78768 3.78119
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.16962 0.16945
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.56465 1.56484
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 2.34262 2.34361
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.23504 0.31096
Minkeyrink ST_st unsat ✅ 0.22234 0.22246
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 7.88650 7.88601
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 8.93680 34.80650
STP-Riss-st-2018_riss-no-stderr unsat ✅ 9.47880 9.47795
Yices2 Yices 2.6.0_default unsat ✅ 0.03052 0.03043
Z3 z3-4.7.1_default unsat ✅ 0.87845 0.87832
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.22582 0.22581
Poolector-wrapped-sq_default unsat ✅ 0.28096 0.36544
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.16082 0.16064
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.67762 0.67768
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.21844 0.26779
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.19777 0.19788
Par4 Par4-wrapped-sq_default unsat ✅ 0.03989 0.00586
STP STP-2019-wrapped-sq_default unsat ✅ 10.11470 10.11550
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 20.17530 20.17480
stp-minisat-wrapped-sq_default unsat ✅ 9.54445 9.54387
stp-mt-wrapped-sq_default unsat ✅ 9.12569 35.47160
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 20.70530 41.07570
stp-riss-wrapped-sq_default unknown ❌ 0.23476 0.23480
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03492 0.03487
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.04909 0.04909
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.04479 0.04478
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 24.74330 24.73930
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.06061 0.06060
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 29.80890 29.80710
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.23801 0.23799
Boolector Boolector-wrapped-sq_default unsat ✅ 0.21700 0.21691
Poolector-wrapped-sq_default unsat ✅ 0.27965 0.38042
CVC4 CVC4-sq-final_default unsat ✅ 0.77471 0.77493
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1199.96000
MathSAT MathSAT5_default.sh unsat ✅ 1.42765 1.42756
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.20579 0.20603
MinkeyRink Solver 2020.3_default unsat ✅ 0.22076 0.27466
STP STP_default unsat ✅ 0.16238 0.19739
STP ++ Mergsat v1_default unsat ✅ 0.14450 0.14616
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.04219 0.04217
Z3 z3-4.8.8_default unsat ✅ 0.77924 0.77913
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.22834 0.22828
Bitwuzla-wrapped_default unsat ✅ 0.22533 0.22460
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.59522 5.59008
MathSAT MathSAT-5.6.8_default unsat ✅ 1.37700 1.37690
STP STP 2022.4_default unsat ✅ 0.16847 0.16850
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.04354 0.04350
Z3++BV z3++bv_0702_default unsat ✅ 1.01598 1.01589
Z3 z3-4.8.17_default unsat ✅ 1.09917 1.10097
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.48871 0.48864
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 6.30764 6.30576
STP STP 2022.4_default unsat ✅ 0.16944 0.16942
STP 2022.4_default unsat ✅ 0.16791 0.16796
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 5.60055 16.75520
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03364 0.03356
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.03000 1199.97000
z3-Owl-Final_default unsat ✅ 141.05600 141.01000
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.34751 0.24776
cvc5 cvc5 unsat ✅ 2.44016 2.34035
SMTInterpol SMTInterpol unknown ❌ 1201.74532 1232.53934
STP STP unsat ✅ 0.33745 0.23704
Yices2 Yices2 unsat ✅ 0.23903 0.13947
Z3alpha Z3-alpha unsat ✅ 43.38426 43.28349