Benchmark

non-incremental/QF_BV/sage/app7/bench_1352.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1823316
Compressed Size127424
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1823308
Compressed Size127430
Max. Term Depth7035
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1659 and1
=2244 let6936 extract1258 bvand18149
bvor11825 bvxor1453 bvadd19782 bvmul1
bvsub6369 bvult438 bvule474 bvslt204
bvsle99 bvshl6207 bvashr11452 zero_extend971

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.25728 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.31665 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.31585 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.31017 —
abziz_portfolio_2012_solvers default unsat ✅ 0.31577 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.31294 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.35042 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.43135 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.37129 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 71.64500 —
CVC3-SMT-COMP-2011 default unsat ✅ 60.63350 —
CVC3-SMT-COMP-2012 default unsat ✅ 63.32230 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.43035 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.40366 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.54168 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.51408 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.68533 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.66943 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.48603 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.50436 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 3.34877 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.76191 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.29414 —
STP2-SMT-COMP-2012 default unsat ✅ 0.25796 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.26811 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.34041 —
Z3-SMT-COMP-2011 default unsat ✅ 0.31692 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.50004 0.49892
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.44644 3.99939
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.43449 3.98939
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.38625 0.38494
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.97000
STP stp-cryptominisat4 default unsat ✅ 0.24469 0.24396
stp-cmsat4-v15 default unsat ✅ 0.24408 0.24296
stp-cmsat4-mt-v15 default unsat ✅ 0.24804 0.24696
stp-minisat-v15 default unsat ✅ 0.24477 0.24396
Yices2 Yices default unsat ✅ 0.11004 0.10898
Z3 z3 4.4.0 default unsat ✅ 0.30701 0.30695
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.04594 1.04662
ABC_glucose glucose unsat ✅ 1.02643 1.02710
Boolector Boolector boolector unsat ✅ 0.62559 0.62657
Boolector preprop boolector unsat ✅ 0.60352 0.60422
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.36393 3.87035
MapleSTP MapleSTP default unsat ✅ 0.23472 0.23482
MapleSTP-mt default unsat ✅ 0.23367 0.23374
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.34766 0.34915
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.33788 0.33804
Q3B Q3B default unsat ✅ 0.56695 0.56896
STP stp-cms-exp-2016 default unsat ✅ 0.23813 0.23824
stp-cms-mt-2016 default unsat ✅ 0.24212 0.24242
stp-cms-st-2016 default unsat ✅ 0.24221 0.24226
stp-minisat-st-2016 default unsat ✅ 0.24200 0.24209
Yices2 Yices-2.4.2 default unsat ✅ 0.10854 0.10857
Z3 z3-4.4.1 default unsat ✅ 0.30968 0.31110
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.45695 0.45649
Boolector SMT17 final boolector unsat ✅ 0.45793 0.45787
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.39614 3.88779
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.35369 0.35339
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.69881 0.69798
Q3B Q3B default unsat ✅ 0.57714 0.57602
STP stp_st default unsat ✅ 0.29867 0.29650
stp_mt default unsat ✅ 0.29782 0.29635
Yices2 Yices2-Main default unsat ✅ 0.10392 0.10262
Z3 z3-4.5.0 default unsat ✅ 0.33626 0.33519
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.40814 0.40809
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.20296 2.20280
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.33990 0.34086
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.70692 0.70686
Minkeyrink ST_st unsat ✅ 0.70707 0.70702
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.30083 0.30086
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.30130 0.30133
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.30208 0.30216
Yices2 Yices 2.6.0_default unsat ✅ 0.10034 0.10027
Z3 z3-4.7.1_default unsat ✅ 0.30439 0.30425
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.80233 0.80221
Poolector-wrapped-sq_default unsat ✅ 0.99594 3.68578
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.64363 0.64345
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.26866 2.26665
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.52020 0.52032
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.52488 0.52454
Par4 Par4-wrapped-sq_default unsat ✅ 0.11909 0.00583
STP STP-2019-wrapped-sq_default unsat ✅ 0.31010 0.31026
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.30857 0.30869
stp-minisat-wrapped-sq_default unsat ✅ 0.31124 0.31136
stp-mt-wrapped-sq_default unsat ✅ 0.30872 0.30883
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.30893 0.30893
stp-riss-wrapped-sq_default unsat ✅ 0.31112 0.31131
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.10423 0.10422
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.10514 0.10517
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.10399 0.10396
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.10277 0.10274
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.10425 0.10428
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.35917 0.35917
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.62625 0.62613
Boolector Boolector-wrapped-sq_default unsat ✅ 0.80187 0.80178
Poolector-wrapped-sq_default unsat ✅ 0.98772 3.46027
CVC4 CVC4-sq-final_default unsat ✅ 2.96729 2.96732
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.43006 0.43001
MathSAT MathSAT5_default.sh unsat ✅ 0.35574 0.35569
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.42905 0.42905
MinkeyRink Solver 2020.3_default unsat ✅ 0.44394 0.44401
STP STP_default unsat ✅ 0.28846 0.28855
STP ++ Mergsat v1_default unsat ✅ 0.28558 0.28731
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.12449 0.12441
Z3 z3-4.8.8_default unsat ✅ 0.21016 0.21009
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.62374 0.62352
Bitwuzla-wrapped_default unsat ✅ 0.66367 0.66352
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.20813 2.20396
MathSAT MathSAT-5.6.8_default unsat ✅ 0.36656 0.36652
STP STP 2022.4_default unsat ✅ 0.33282 0.33275
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.12549 0.12543
Z3++BV z3++bv_0702_default unsat ✅ 0.22206 0.22196
Z3 z3-4.8.17_default unsat ✅ 0.22469 0.22654
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.98729 0.98717
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.68414 1.68421
STP STP 2022.4_default unsat ✅ 0.33085 0.33084
STP 2022.4_default unsat ✅ 0.33107 0.33105
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 489.74700 564.92000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.12017 0.12014
Z3-Owl z3-Owl-Final_default unsat ✅ 0.92659 0.92651
z3-Owl-Final_default unsat ✅ 0.93730 0.93449