Benchmark

non-incremental/QF_ABV/platania/no_init_bubble_sort/no_init_bubble_sort_safe17.c.smt2

The benchmarks come from Bounded Model Checking of software. Each of them is a
family of formulae obtained during the check of a program and is parametric in
the size of the arrays. They actually don't involve Uninterpreted Functions but
just Arrays and Bitvectors.

This family contains formulae modeling the Bubble Sort algorithm for sorting an
array of N (the increasing parameter) elements. Differently from the
bubble_sort benchmarks, here arrays are not instantiated, that results in
arrays with unconstrained elements.

Contributed by Lorenzo Platania (c1009@unige.it).  Translated from CVC format
by Clark Barrett.
Benchmark
Size687720
Compressed Size39855
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status None
Size 687712
Compressed Size39864
Max. Term Depth2147
Asserts 1331
Declared Functions0
Declared Constants1337
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1328 not33 and4689 =>1071
=1330 let1328 bvadd1296 bvsub3921
bvult4450 bvule545 select2065 store512

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 1.00 (0/2) Yices Yices 1.0.10 unknown ❌ 1801.00000
Z3 Z3 0.1 unknown ❌ 1800.70000
Z3 0.1 (fixed BV) unknown ❌ 1800.70000
SMT-COMP 2008 1.00 (0/3) Boolector Boolector unknown ❌ 1801.00000
CVC3 CVC3-1.5 unknown ❌ 1800.80000
Z3 Z3 0.1 unknown ❌ 1800.80000
Z3.2 unknown ❌ 1801.00000
SMT-COMP 2009 1.00 (0/4) Boolector Boolector unknown ❌ 900.00000
Boolector 1.2 unknown ❌ 900.00000
CVC3 CVC3 2.0 unknown ❌ 900.00000
MathSAT MathSAT 4.3 unknown ❌ 745.70000
Yices2 Yices 2 proto unknown ❌ 900.00000
SMT-COMP 2010 1.00 (0/2) Boolector Boolector 1.2 unknown ❌ 1200.00000
CVC3 CVC3 2.3 unknown ❌ 48.00000
SMT-COMP 2012 0.75 (1/4) Boolector Boolector unknown ❌ 1200.00000
Boolector 1.5.23-833 unknown ❌ 1200.00000
CVC3 CVC3 v2.4.2 unknown ❌
CVC4 1.0rc.3931 unknown ❌ 1200.00000
CVC4 1.0rc.3970 unknown ❌ 1200.00000
SONOLAR SONOLAR unknown ❌ 1200.00000
Tiffany de Wintermonte Tiffany de Wintermonte & Sonolar unsat ✅ 295.70000
SMT-COMP 2011 1.00 (0/5) Boolector Boolector 1.5.23-833 unknown ❌ 1200.00000
CVC3 CVC3 v2.4 unknown ❌ 1200.10000
MathSAT MathSAT5 unknown ❌ 1200.00000
SONOLAR SONOLAR unknown ❌ 1200.00000
Z3 Z3 unknown ❌ 1200.00000
SMT Evaluation 2013 1.00 (0/7) Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌
Boolector-SMT-COMP-2011 default unknown ❌
Boolector-SMT-COMP-2012 default unknown ❌
CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unknown ❌
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌
MathSAT5-SMT-COMP-2011 default unknown ❌
MathSAT5-SMT-COMP-2012 default unknown ❌
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌
SONOLAR-SMT-COMP-2011 default unknown ❌
SONOLAR-SMT-COMP-2012 default unknown ❌
Tiffany de Wintermonte TdW-SMT-COMP-2012 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌
Z3-SMT-COMP-2011 default unknown ❌
SMT-COMP 2014 0.86 (1/7) Boolector Boolector boolectord unsat ✅ 657.72600 658.03200
Boolector boolectorj unsat ✅ 698.55800 698.67800
CVC4 CVC4 f7118b2 default unknown ❌ 2399.12000 2400.06000
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.03138 0.01500
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.04439 0.03199
MathSAT MathSAT-5.2.12-Main default unknown ❌ 2399.02000 2400.03000
SONOLAR sonolar_smtcomp-2014 default unknown ❌ 2399.12000 2400.02000
Yices2 Yices-2.2.1-smtcomp2014 default unknown ❌ 2399.21000 2400.02000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.21000 2400.06000
SMT-COMP 2015 0.80 (1/5) Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv unsat ✅ 178.93600 178.97400
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2400.77000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2400.76000
MathSAT MathSat 5.3.6 main smtcomp2015_main unknown ❌ 2400.01000 2400.78000
Yices2 Yices default unknown ❌ 2400.01000 2400.60000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.88000
SMT-COMP 2016 1.00 (0/5) Boolector Boolector boolector unknown ❌ 2400.02000 2401.33000
CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.02000 2401.15000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unknown ❌ 2400.02000 2401.22000
Yices2 Yices-2.4.2 default unknown ❌ 2400.02000 2401.27000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.25000
SMT-COMP 2017 1.00 (0/5) Boolector Boolector SMT17 final boolector unknown ❌ 600.02000 599.95000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.09900 599.47300
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.01900 599.89000
Yices2 Yices2-Main default unknown ❌ 600.01300 599.90200
Z3 z3-4.5.0 default unknown ❌ 600.02100 599.78000
SMT-COMP 2018 1.00 (0/5) Boolector Boolector_default unknown ❌ 1200.09000 1199.94000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.11000 1199.75000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.06000 1199.94000
Yices2 Yices 2.6.0_default unknown ❌ 1200.11000 1199.96000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.88000
SMT-COMP 2019 1.00 (0/5) Boolector Boolector-wrapped-sq_default unknown ❌ 2400.11000 2399.85000
Poolector-wrapped-sq_default unknown ❌ 2400.12000 9512.75000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.02000 2399.57000
Par4 Par4-wrapped-sq_default unknown ❌ 2400.18000 7199.49000
Yices2 Yices 2.6.2-wrapped-sq_default unknown ❌ 2400.04000 2399.77000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.10000 2399.97000
SMT-COMP 2022 1.00 (0/5) Bitwuzla Bitwuzla-wrapped_default unknown ❌ 1200.04000 1199.95000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 1195.98000
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.11000 1199.81000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.77000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.74000