Benchmark

non-incremental/QF_BV/sage/app1/bench_2173.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size72725
Compressed Size10375
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 72717
Compressed Size10384
Max. Term Depth172
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite74 not74 and1
=191 let162 extract1 bvand40
bvor171 bvadd360 bvmul5 bvsub226
bvult247 bvule541 bvslt1 bvsle47
bvshl172 bvashr5 zero_extend302

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 1.40485 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 4.04369 —
abziz_portfolio_2011_solvers_2 default sat ✅ 3.89250 —
abziz_portfolio_2012_minfeatures default sat ✅ 3.87926 —
abziz_portfolio_2012_solvers default sat ✅ 3.93988 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 4.02731 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 8.29275 —
Boolector-SMT-COMP-2011 default sat ✅ 3.26052 —
Boolector-SMT-COMP-2012 default sat ✅ 0.56669 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 2.35891 —
CVC4-SMT-EVAL-2013 default sat ✅ 2.09969 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 2.36863 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 2.41516 —
MathSAT5-SMT-COMP-2011 default sat ✅ 2.13738 —
MathSAT5-SMT-COMP-2012 default sat ✅ 2.08280 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 1.38425 —
SONOLAR-SMT-COMP-2010 default sat ✅ 2.24426 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.66561 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.68420 —
STP STP2-SMT-COMP-2011 default sat ✅ 3.32077 —
STP2-SMT-COMP-2012 default sat ✅ 4.36727 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 19.22240 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 5.27500 —
Z3-SMT-COMP-2011 default sat ✅ 3.88045 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 4.20729 4.20736
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 6.93108 13.83390
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 6.87209 13.72290
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 3.16157 3.16152
SMT-RAT SMT-RAT-final default sat ✅ 1108.59000 1109.13000
STP stp-cryptominisat4 default sat ✅ 6.88629 6.88795
stp-cmsat4-v15 default sat ✅ 23.92130 23.92540
stp-cmsat4-mt-v15 default unknown ❌ 0.41021 0.40894
stp-minisat-v15 default sat ✅ 6.29780 6.29804
Yices2 Yices default sat ✅ 0.93662 0.93586
Z3 z3 4.4.0 default sat ✅ 7.14120 7.14391
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 58.23230 58.25120
ABC_glucose glucose sat ✅ 11.85650 11.84730
Boolector Boolector boolector sat ✅ 6.85829 6.86235
Boolector preprop boolector sat ✅ 6.89915 6.90368
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 15.74660 31.53200
MapleSTP MapleSTP default sat ✅ 145.08800 145.14800
MapleSTP-mt default sat ✅ 265.79800 1057.40000
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 2.53564 2.53817
MinkeyRink Minkeyrink 2016 default sat ✅ 3.51299 9.74471
Q3B Q3B default unknown ❌ 2400.02000 7204.24000
STP stp-cms-exp-2016 default sat ✅ 97.68850 97.71930
stp-cms-mt-2016 default sat ✅ 12.31730 47.84810
stp-cms-st-2016 default sat ✅ 33.36810 33.38720
stp-minisat-st-2016 default sat ✅ 42.96380 42.98570
Yices2 Yices-2.4.2 default sat ✅ 1.85370 1.85473
Z3 z3-4.4.1 default sat ✅ 15.31020 30.52040
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.87588 0.87062
Boolector SMT17 final boolector sat ✅ 2.54018 2.53701
CVC4 CVC4-smtcomp2017-main default sat ✅ 9.08980 18.17940
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 3.71457 3.71447
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.50392 1.50581
Q3B Q3B default unknown ❌ 600.10000 1799.68000
STP stp_st default sat ✅ 18.19620 18.19230
stp_mt default sat ✅ 21.60680 53.25300
Yices2 Yices2-Main default sat ✅ 2.49488 2.49445
Z3 z3-4.5.0 default sat ✅ 6.27994 6.28054
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.62483 0.62445
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 11.24130 11.23980
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 2.18739 2.18810
MinkeyRink Minkeyrink MT_mt sat ✅ 2.12436 7.62642
Minkeyrink ST_st sat ✅ 3.08949 3.08916
STP STP-CMS-st-2018_default-no-stderr sat ✅ 17.03150 17.02880
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 20.42270 79.10960
STP-Riss-st-2018_riss-no-stderr sat ✅ 7.06625 7.06365
Yices2 Yices 2.6.0_default sat ✅ 2.98688 2.98690
Z3 z3-4.7.1_default sat ✅ 9.26925 9.26894
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 2.76880 2.76872
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 13.31590 13.31560
STP STP 2022.4_default sat ✅ 1.07714 1.07712
STP 2022.4_default sat ✅ 1.07163 1.07156
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1255.52000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 1.69088 1.69070
Z3-Owl z3-Owl-Final_default sat ✅ 17.08890 17.08810
z3-Owl-Final_default sat ✅ 18.97490 18.97340
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.49396 0.39386
cvc5 cvc5 sat ✅ 9.14653 9.04039
SMTInterpol SMTInterpol unknown ❌ 1201.72349 1233.10770
STP STP sat ✅ 0.51499 0.41457
Yices2 Yices2 sat ✅ 1.34952 1.24983
Z3alpha Z3-alpha sat ✅ 8.71899 8.61535