Benchmark

non-incremental/QF_LIA/nec-smt/large/getoption_group/prp-50-48.smt2

http://www.nec-labs.com/~fsoft/bench.html 
 The following changes have been made: 
 The logic is changed to QF_LIA. 
 The category is set as industrial. 
 The status (except 'large' cases) is assigned according to the 'outfile' on http://www.nec-labs.com/~fsoft/bench.html.
Benchmark
Size267396
Compressed Size53901
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 267388
Compressed Size53888
Max. Term Depth1574
Asserts 1
Declared Functions0
Declared Constants80
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite7457 not1234 and5
=3566 let1253 +621 -167
*14 <=354

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2011 0.40 (3/5) CVC3 CVC3 v2.4 unknown ❌ 1200.30000
MathSAT MathSAT 5 unsat ✅ 6.80000
MathSAT5 unsat ✅ 6.50000
SMTInterpol SMTInterpol 2.0pre unknown ❌ 1200.20000
Yices2 smtlib2parser+Yices 1.0.29 unsat ✅ 429.20000
Z3 Z3 unsat ✅ 28.80000
SMT Evaluation 2013 0.17 (5/6) CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 869.16500
CVC3-SMT-COMP-2011 default unsat ✅ 803.90400
CVC3-SMT-COMP-2012 default unsat ✅ 810.82000
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 92.45020
CVC4-SMT-EVAL-2013 default unsat ✅ 92.55160
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 3.18448
MathSAT5-SMT-COMP-2010 default unsat ✅ 3.67684
MathSAT5-SMT-COMP-2011 default unsat ✅ 3.57363
MathSAT5-SMT-COMP-2012 default unsat ✅ 3.35835
test_pmathsat-SMT-COMP-2010 default unsat ✅ 5.05335
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 13.29150
SMTInterpol-SMT-COMP-2011 default unknown ❌
SMTInterpol-SMT-COMP-2012 default unknown ❌
veriT veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 16.31070
Z3-SMT-COMP-2011 default unsat ✅ 16.83590
SMT-COMP 2014 0.17 (5/6) CVC4 CVC4 f7118b2 default unsat ✅ 10.91640 10.91030
MathSAT MathSAT-5.2.12-Main default unsat ✅ 3.22502 3.21551
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 15.77330 23.03250
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.09000
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.54771 0.53892
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 16.20140 16.19950
SMT-COMP 2015 0.29 (5/7) CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 10.98720 10.98630
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 11.04140 11.04430
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 3.24945 3.24950
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 15.67560 25.82910
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.76000
veriT veriT default unknown ❌ 2400.01000 2401.02000
Yices2 Yices default unsat ✅ 0.40441 0.40294
Z3 z3 4.4.0 default unsat ✅ 16.92290 16.92940
SMT-COMP 2016 0.38 (5/8) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 10.98210 10.98850
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 3.06140 3.06386
ProB ProB competition unknown ❌ 2400.12000 2401.53000
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 17.62080 36.62670
SMT-RAT SMT-RAT default unknown ❌ 2400.04000 2401.64000
veriT veriT-dev default unknown ❌ 2400.02000 2401.19000
Yices2 Yices-2.4.2 default unsat ✅ 0.46825 0.46846
Z3 z3-4.4.1 default unsat ✅ 17.34420 17.35690
SMT-COMP 2017 0.29 (5/7) CVC4 CVC4-smtcomp2017-main default unsat ✅ 11.95200 11.94950
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 3.25049 3.25082
SMTInterpol SMTInterpol default unsat ✅ 20.55740 38.11790
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.01300 599.97700
veriT veriT-2017-06-17 default unknown ❌ 600.02700 600.01800
Yices2 Yices2-Main default unsat ✅ 0.40534 0.40381
Z3 z3-4.5.0 default unsat ✅ 18.74810 18.74590
SMT-COMP 2018 0.25 (6/8) Ctrl-Ergo Ctrl-Ergo-SMTComp-2018_default unsat ✅ 14.61040 57.83000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 13.02730 13.02610
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 37.48150 37.47720
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 19.76150 34.92540
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.01000 1199.90000
veriT veriT_default unknown ❌ 1200.10000 1200.05000
Yices2 Yices 2.6.0_default unsat ✅ 0.47050 0.47043
Z3 z3-4.7.1_default unsat ✅ 16.90930 16.90710
SMT-COMP 2019 0.25 (6/8) Ctrl-Ergo Ctrl-Ergo-2019-wrapped-sq_default unsat ✅ 15.39140 60.90000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 13.00750 13.00600
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 51.15710 38.11460
Par4 Par4-wrapped-sq_default unsat ✅ 0.57535 0.00568
ProB ProB-wrapped-sq_default unknown ❌ 2400.02000 2399.88000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 30.60780 49.79230
veriT veriT-wrapped-sq_default unknown ❌ 2400.02000 2399.82000
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.58386 0.58382
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 15.35200 15.34200
SMT-COMP 2022 0.17 (5/6) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 144.50100 144.47800
MathSAT MathSAT-5.6.8_default unsat ✅ 55.84790 55.84070
Par4 Par4-wrapped-sq_default unsat ✅ 0.57609 1.66000
veriT veriT_default unknown ❌ 1200.07000 1199.88000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.56294 0.56286
Z3 z3-4.8.17_default unsat ✅ 85.14850 85.13670
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 146.19200 146.16700
OpenSMT OpenSMT a78dcf01_default unsat ✅ 40.66960 40.66900
Par4 Par4-wrapped-sq_default unsat ✅ 0.53638 1.53000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 74.87760 124.73000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.73294 0.73270
Z3++ Z3++_sq_0526_default unsat ✅ 97.53840 97.52760
SMT-COMP 2024 0.20 (4/5) cvc5 cvc5 unsat ✅ 101.18360 101.04674
OpenSMT OpenSMT unsat ✅ 28.53013 28.42595
SMTInterpol SMTInterpol unsat ✅ 57.52620 104.78443
Yices2 Yices2 unsat ✅ 0.57590 0.47527
Z3alpha Z3-alpha unknown ❌ 1201.72103 1201.02137
SMT-COMP 2025 0.33 (4/6) cvc5 cvc5 unsat ✅ 325.49170 325.28885
OpenSMT OpenSMT unsat ✅ 27.64328 27.50911
SMTInterpol SMTInterpol unsat ✅ 52.79588 79.83659
Yices2 Yices2 unsat ✅ 0.62509 0.50059
Z3alpha Z3-alpha unknown ❌ 1201.75123 1201.03746
Z3 Z3-alpha-base unknown ❌ 1201.24491 1200.97682