Benchmark

non-incremental/QF_ABV/stp/testcase17.stp.smt2 

From Vijay Ganesh, see http://theory.stanford.edu/~vganesh/stp.html
Benchmark
Size63296185
Compressed Size4104920
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 63296177
Compressed Size4104924
Max. Term Depth7
Asserts 1
Declared Functions0
Declared Constants749727
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1185 false1 ite50877 not25048
and1 =407754 let2 extract48939
bvnot26 bvand10474 bvor775 bvxor1195
bvadd58143 bvmul10 bvsub5967 bvult634
bvule354 bvslt25 bvsle237 bvshl5166
bvlshr1169

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.50 (1/2) Yices Yices 1.0.10 unknown ❌ 1801.00000 —
Z3 Z3 0.1 sat ✅ 17.80000 —
Z3 0.1 (fixed BV) sat ✅ 17.80000 —
SMT-COMP 2008 0.33 (2/3) Boolector Boolector sat ✅ 8.80000 —
CVC3 CVC3-1.5 unknown ❌ 608.90000 —
Z3 Z3 0.1 sat ✅ 17.90000 —
Z3.2 sat ✅ 21.10000 —
SMT-COMP 2010 0.50 (1/2) Boolector Boolector 1.2 sat ✅ 10.70000 —
CVC3 CVC3 2.3 unknown ❌ 347.10000 —
SMT-COMP 2011 0.40 (3/5) Boolector Boolector 1.5.23-833 sat ✅ 15.30000 —
CVC3 CVC3 v2.4 unknown ❌ 201.20000 —
MathSAT MathSAT5 sat ✅ 163.40000 —
SONOLAR SONOLAR unknown ❌ 51.40000 —
Z3 Z3 sat ✅ 19.70000 —
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 8.22609 —
Boolector-SMT-COMP-2011 default sat ✅ 9.40209 —
Boolector-SMT-COMP-2012 default sat ✅ 8.86481 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 340.85100 —
CVC3-SMT-COMP-2011 default sat ✅ 280.95300 —
CVC3-SMT-COMP-2012 default sat ✅ 286.28700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 364.02000 —
CVC4-SMT-EVAL-2013 default sat ✅ 349.15800 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 15.95570 —
MathSAT5-SMT-COMP-2011 default sat ✅ 65.50150 —
MathSAT5-SMT-COMP-2012 default sat ✅ 47.79140 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 18.17010 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default sat ✅ 17.07270 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default sat ✅ 10.29290 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 10.60550 —
Z3-SMT-COMP-2011 default sat ✅ 9.73208 —
SMT-COMP 2014 0.14 (6/7) Boolector Boolector boolectord sat ✅ 13.22700 13.22900
Boolector boolectorj sat ✅ 13.14840 13.15100
CVC4 CVC4 f7118b2 default sat ✅ 82.25740 82.27550
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 7.77077 7.76382
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 8.70984 8.69468
MathSAT MathSAT-5.2.12-Main default sat ✅ 18.66460 18.65320
SONOLAR sonolar_smtcomp-2014 default sat ✅ 22.67000 22.66560
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 3.26215 3.22551
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 12.53700 12.54010
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 15.93170 15.93760
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 54.90930 54.93460
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 135.82900 135.87700
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 15.87230 15.87760
Yices2 Yices default sat ✅ 3.18872 3.18851
Z3 z3 4.4.0 default sat ✅ 12.20200 12.20710
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 19.93970 19.95130
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 196.78300 180.64600
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 14.72790 14.73860
Yices2 Yices-2.4.2 default sat ✅ 3.14911 3.15084
Z3 z3-4.4.1 default sat ✅ 11.98190 11.98350
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 19.29610 19.29630
CVC4 CVC4-smtcomp2017-main default sat ✅ 130.44800 115.18500
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 15.52060 15.51970
Yices2 Yices2-Main default sat ✅ 3.13903 3.13875
Z3 z3-4.5.0 default sat ✅ 12.94710 12.94650
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 17.67710 17.67700
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 133.26000 120.42200
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 14.93950 14.93780
Yices2 Yices 2.6.0_default sat ✅ 3.22674 3.22617
Z3 z3-4.7.1_default sat ✅ 14.02570 14.02440
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 20.61920 41.20790
Poolector-wrapped-sq_default sat ✅ 23.74660 93.37610
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 59.15250 59.14680
Par4 Par4-wrapped-sq_default sat ✅ 3.06426 8.99000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 3.24964 3.24953
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 12.89480 12.89480
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 18.15020 36.16360
Boolector Boolector-wrapped-sq_default sat ✅ 21.26200 42.41940
CVC4 CVC4-sq-final_default sat ✅ 136.90300 119.89200
MathSAT MathSAT5_default.sh sat ✅ 13.06760 13.06760
Par4 Par4-wrapped-sq_default sat ✅ 3.14012 9.32000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 3.49343 3.49303
Z3 z3-4.8.8_default sat ✅ 11.70950 11.70940
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 13.25620 13.25490
Yices2 Yices 2.6.2 bug fix_default sat ✅ 3.44460 3.44419
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 3.47027 3.47014
Z3 z3-4.8.11_default sat ✅ 13.15420 13.15130
SMT-COMP 2022 Bitwuzla Bitwuzla-wrapped_default sat ✅ 17.11270 17.10450
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 143.77200 136.81700
MathSAT MathSAT-5.6.8_default sat ✅ 14.29890 14.29840
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 11.00970 11.01000
Z3 z3-4.8.17_default sat ✅ 13.41430 13.41590
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default sat ✅ 41.77220 41.77070
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 42.01510 42.00420
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.11000 1352.62000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 11.27100 11.27030
Z3-Owl z3-Owl-Final_default sat ✅ 27.75460 27.74970
z3-Owl-Final_default sat ✅ 32.69510 32.69430
SMT-COMP 2025 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 17.46717 17.33139
cvc5 cvc5 sat ✅ 27.29116 27.18643
SMTInterpol SMTInterpol unknown ❌ 131.56974 461.38819
Yices2 Yices2 sat ✅ 7.40906 7.27813
Z3 Z3-Owl-base sat ✅ 54.88173 54.75770
Z3-Owl Z3-Owl sat ✅ 21.13040 20.99978