Benchmark

non-incremental/QF_BV/spear/inn_v2.4.3/innd_innd_vc33348.smt2

Benchmarks generated by the Calysto static checker.  Provided by Domagoj
Babic.  See http://www.cs.ubc.ca/~babic/index_benchmarks.htm.  Translated using
Spear Sf2Smt translator.
Benchmark
Size27938
Compressed Size4408
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 27930
Compressed Size4423
Max. Term Depth5
Asserts 246
Declared Functions0
Declared Constants296
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite53 =>4 =372 distinct11
concat1 extract98 bvand51 bvadd2
bvudiv2 bvsub2 bvsrem1 bvult7
bvule6 bvslt16 bvsle15 bvshl1
zero_extend1 sign_extend8

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 Spear Spear v1.9 (fh-1-2) sat ✅ 17.00000
Spear v1.9 (sw-v) sat ✅ 17.30000
Yices Yices 1.0.10 sat ✅ 0.50000
Z3 Z3 0.1 sat ✅ 1.00000
Z3 0.1 (fixed BV) sat ✅ 1.00000
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 1.15551
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 2.48749
abziz_portfolio_2011_solvers_2 default sat ✅ 2.54979
abziz_portfolio_2012_minfeatures default sat ✅ 2.49110
abziz_portfolio_2012_solvers default sat ✅ 2.50400
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 2.52097
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.39442
Boolector-SMT-COMP-2011 default sat ✅ 11.12460
Boolector-SMT-COMP-2012 default sat ✅ 0.11800
CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 5.47034
CVC4-SMT-EVAL-2013 default sat ✅ 1.83063
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 4.53412
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 4.73750
MathSAT5-SMT-COMP-2011 default sat ✅ 0.64233
MathSAT5-SMT-COMP-2012 default sat ✅ 0.66553
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 2.60439
SONOLAR-SMT-COMP-2010 default sat ✅ 4.22869
SONOLAR-SMT-COMP-2011 default sat ✅ 1.19458
SONOLAR-SMT-COMP-2012 default sat ✅ 2.45845
STP STP2-SMT-COMP-2011 default sat ✅ 0.68783
STP2-SMT-COMP-2012 default sat ✅ 0.93449
simplifyingSTP-SMT-COMP-2010 default sat ✅ 6.03547
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 4.11553
Z3-SMT-COMP-2011 default sat ✅ 2.47468
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.01555 0.01500
Boolector SMT17 final boolector sat ✅ 0.01648 0.01496
CVC4 CVC4-smtcomp2017-main default sat ✅ 2.49193 4.94715
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 3.89943 3.89283
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.37440 1.35226
Q3B Q3B default sat ✅ 0.50068 0.40001
STP stp_st default sat ✅ 1.37337 1.37355
stp_mt default sat ✅ 1.40706 4.14964
Yices2 Yices2-Main default sat ✅ 0.11229 0.11126
Z3 z3-4.5.0 default sat ✅ 2.81973 2.81850
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.01537 0.01531
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 16.04900 16.04250
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 4.13347 4.13392
MinkeyRink Minkeyrink MT_mt sat ✅ 0.63872 1.00700
Minkeyrink ST_st sat ✅ 0.54044 0.54022
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.83142 0.83029
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.59409 1.08572
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.69302 1.69286
Yices2 Yices 2.6.0_default sat ✅ 0.10313 0.10306
Z3 z3-4.7.1_default sat ✅ 4.52264 4.52273
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.01660 0.01660
Poolector-wrapped-sq_default sat ✅ 0.17750 0.20408
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 8.00669 8.00661
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 2.04876 2.04897
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.49680 0.67333
MinkeyRink ST-wrapped-sq_default sat ✅ 0.61757 0.61762
Par4 Par4-wrapped-sq_default sat ✅ 0.02352 0.00606
STP STP-2019-wrapped-sq_default sat ✅ 0.55867 0.55097
stp-mergesat-fixed-wrapped-sq_default sat ✅ 11.78080 11.76720
stp-minisat-wrapped-sq_default sat ✅ 0.65019 0.65038
stp-mt-wrapped-sq_default sat ✅ 0.54489 0.81486
stp-portfolio-fixed-wrapped-sq_default sat ✅ 11.85350 12.34300
stp-riss-wrapped-sq_default unknown ❌ 0.44907 0.44929
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.11778 0.11781
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.28389 0.28386
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 2.62499 2.62469
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.09343 0.09341
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.34924 0.34920
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 7.65280 7.65198
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.20025 0.20018
Boolector Boolector-wrapped-sq_default sat ✅ 0.01679 0.01680
Poolector-wrapped-sq_default sat ✅ 0.17885 0.18197
CVC4 CVC4-sq-final_default sat ✅ 1.75356 1.75358
LazyBV2Int LazyBV2Int20200523_default.sh sat ✅ 4.89195 4.89171
MathSAT MathSAT5_default.sh sat ✅ 0.80103 0.80099
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.43604 0.43624
MinkeyRink Solver 2020.3_default sat ✅ 0.67955 1.41633
STP STP_default sat ✅ 0.55659 1.01919
STP ++ Mergsat v1_default sat ✅ 0.40450 0.40635
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.33324 0.33317
Z3 z3-4.8.8_default sat ✅ 6.77178 6.76971