Benchmark

non-incremental/QF_BV/asp/TravellingSalesperson/rand_80_340_1159656267_6.lp.smt2

Benchmark without description.
Benchmark
Size932060
Compressed Size107802
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 932052
Compressed Size107810
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants10975
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1783 not6593 or997 and1351
=>6883 =14225 bvsub3079 bvugt672
bvuge321

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.22 (7/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 647.91900
abziz_portfolio_2011_solvers_2 default unknown ❌
abziz_portfolio_2012_minfeatures default unknown ❌
abziz_portfolio_2012_solvers default sat ✅ 125.70800
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 121.79200
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 208.74500
Boolector-SMT-COMP-2011 default sat ✅ 349.03800
Boolector-SMT-COMP-2012 default sat ✅ 417.39700
CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default sat ✅ 386.91200
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 318.77900
MathSAT5-SMT-COMP-2011 default unknown ❌
MathSAT5-SMT-COMP-2012 default unknown ❌
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌
SONOLAR-SMT-COMP-2010 default sat ✅ 1113.18000
SONOLAR-SMT-COMP-2011 default sat ✅ 644.12900
SONOLAR-SMT-COMP-2012 default sat ✅ 476.53300
STP STP2-SMT-COMP-2011 default sat ✅ 410.59800
STP2-SMT-COMP-2012 default unknown ❌
simplifyingSTP-SMT-COMP-2010 default sat ✅ 253.08000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 79.63700
Z3-SMT-COMP-2011 default sat ✅ 119.98400
SMT-COMP 2015 0.29 (5/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 226.16700 226.26800
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 612.91500 1229.48000
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 161.05100 322.50900
MathSAT MathSat 5.3.6 main smtcomp2015_main unknown ❌ 2400.01000 2400.74000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.94000
STP stp-cryptominisat4 default sat ✅ 249.83300 249.89900
stp-cmsat4-v15 default sat ✅ 328.38900 328.46800
stp-cmsat4-mt-v15 default unknown ❌ 3.89594 3.89641
stp-minisat-v15 default unknown ❌ 2400.02000 2400.94000
Yices2 Yices default sat ✅ 469.84900 470.02400
Z3 z3 4.4.0 default sat ✅ 147.08800 147.13700
SMT-COMP 2016 0.20 (8/10) ABC ABC_default default_abc sat ✅ 1719.23000 1720.30000
ABC_glucose glucose sat ✅ 122.61700 122.67700
Boolector Boolector boolector sat ✅ 269.04100 269.17300
Boolector preprop boolector sat ✅ 271.11500 271.28400
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 212.52400 426.01800
MapleSTP MapleSTP default sat ✅ 1472.57000 1473.50000
MapleSTP-mt default sat ✅ 394.93500 1554.47000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unknown ❌ 2400.12000 2401.34000
MinkeyRink Minkeyrink 2016 default sat ✅ 93.76240 324.65700
Q3B Q3B default unknown ❌ 2400.02000 7203.18000
STP stp-cms-exp-2016 default sat ✅ 544.03900 544.29300
stp-cms-mt-2016 default sat ✅ 170.14500 662.83700
stp-cms-st-2016 default sat ✅ 237.51400 237.65000
stp-minisat-st-2016 default unknown ❌ 2400.03000 2401.58000
Yices2 Yices-2.4.2 default sat ✅ 780.75000 781.17400
Z3 z3-4.4.1 default sat ✅ 94.10720 94.16240
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 468.16500 467.67300
Boolector SMT17 final boolector sat ✅ 249.91900 249.88600
CVC4 CVC4-smtcomp2017-main default sat ✅ 222.57700 446.46100
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.10300 599.90000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 57.65560 108.78000
Q3B Q3B default unknown ❌ 600.05800 1784.24000
STP stp_st default sat ✅ 222.67300 222.57000
stp_mt default sat ✅ 99.56750 380.59400
Yices2 Yices2-Main default unknown ❌ 600.01400 599.91800
Z3 z3-4.5.0 default sat ✅ 91.03620 91.03460
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 220.15800 220.16200
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 159.30500 159.29800
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.02000 1199.87000
MinkeyRink Minkeyrink MT_mt sat ✅ 81.41330 314.46400
Minkeyrink ST_st sat ✅ 63.82650 63.82510
STP STP-CMS-st-2018_default-no-stderr sat ✅ 85.84020 85.83590
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 105.41000 404.30500
STP-Riss-st-2018_riss-no-stderr sat ✅ 219.84400 219.81100
Yices2 Yices 2.6.0_default sat ✅ 747.47500 747.37200
Z3 z3-4.7.1_default sat ✅ 140.87500 140.87300
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 29.06640 29.06440
Poolector-wrapped-sq_default sat ✅ 36.86710 145.69000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 55.11800 55.11670
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 40.68010 40.68050
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 69.34010 266.91800
MinkeyRink ST-wrapped-sq_default sat ✅ 75.53470 75.53050
Par4 Par4-wrapped-sq_default sat ✅ 177.44900 532.14000
STP STP-2019-wrapped-sq_default sat ✅ 92.21800 92.19480
stp-mergesat-fixed-wrapped-sq_default sat ✅ 272.04600 271.98400
stp-minisat-wrapped-sq_default sat ✅ 182.60300 182.58500
stp-mt-wrapped-sq_default sat ✅ 92.12690 352.36600
stp-portfolio-fixed-wrapped-sq_default sat ✅ 277.86100 564.18200
stp-riss-wrapped-sq_default unknown ❌ 4.76398 4.55966
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 599.68200 599.64200
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 71.48570 71.47640
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 78.42950 78.41020
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.80000
Yices 2.6.2 new bvsolver-wrapped-sq_default unknown ❌ 2400.10000 2399.74000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 74.29910 74.29370
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 11.20970 11.20900
Boolector Boolector-wrapped-sq_default sat ✅ 15.63560 15.63490
Poolector-wrapped-sq_default sat ✅ 19.73060 77.79060
CVC4 CVC4-sq-final_default sat ✅ 34.34330 34.33990
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.82000
MathSAT MathSAT5_default.sh unknown ❌ 1200.10000 1199.74000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 3.01591 3.00765
MinkeyRink Solver 2020.3_default sat ✅ 66.35920 254.34600
STP STP_default sat ✅ 126.64400 491.28700
STP ++ Mergsat v1_default sat ✅ 420.12100 420.08700
Yices2 Yices 2.6.2 bug fix_default sat ✅ 8.18629 8.18563
Z3 z3-4.8.8_default sat ✅ 79.31300 79.31540
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 16.17530 16.17330
Bitwuzla-wrapped_default sat ✅ 10.73350 10.73260
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 103.30200 103.27600
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.08000 1199.84000
STP STP 2022.4_default sat ✅ 12.16200 12.15930
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 16.40570 16.40480
Z3++BV z3++bv_0702_default sat ✅ 18.89430 18.89150
Z3 z3-4.8.17_default sat ✅ 110.00400 109.99400
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 31.22390 31.22120
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 94.15670 94.14450
STP STP 2022.4_default sat ✅ 15.95120 15.93870
STP 2022.4_default sat ✅ 15.75800 15.75770
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1248.08000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 962.08800 961.99500
Z3-Owl z3-Owl-Final_default sat ✅ 360.33300 360.05500
z3-Owl-Final_default sat ✅ 90.86300 90.85040