Benchmark

non-incremental/QF_LIA/nec-smt/large/checkpass_pwd/prp-30-49.smt2 

http://www.nec-labs.com/~fsoft/bench.html 
 The following changes have been made: 
 The logic is changed to QF_LIA. 
 The category is set as industrial. 
 The status (except 'large' cases) is assigned according to the 'outfile' on http://www.nec-labs.com/~fsoft/bench.html.
Benchmark
Size378014
Compressed Size79613
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2008-07-07
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 378006
Compressed Size79619
Max. Term Depth1896
Asserts 1
Declared Functions0
Declared Constants119
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite9736 not2225 and19
=4808 let1698 +1231 -347
*104 <=471

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.17 (5/6) CVC3 CVC3-SMT-COMP-2010 default sat ✅ 160.43000 —
CVC3-SMT-COMP-2011 default sat ✅ 144.59600 —
CVC3-SMT-COMP-2012 default sat ✅ 145.04000 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 110.81700 —
CVC4-SMT-EVAL-2013 default sat ✅ 71.12660 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 40.45470 —
MathSAT5-SMT-COMP-2010 default sat ✅ 38.38490 —
MathSAT5-SMT-COMP-2011 default sat ✅ 35.07200 —
MathSAT5-SMT-COMP-2012 default sat ✅ 38.96070 —
test_pmathsat-SMT-COMP-2010 default sat ✅ 37.03450 —
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default sat ✅ 21.70080 —
SMTInterpol-SMT-COMP-2011 default unknown ❌ — —
SMTInterpol-SMT-COMP-2012 default unknown ❌ — —
veriT veriT-SMT-EVAL-2013 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 62.59990 —
Z3-SMT-COMP-2011 default sat ✅ 54.39820 —
SMT-COMP 2014 0.17 (5/6) CVC4 CVC4 f7118b2 default sat ✅ 37.70960 37.70930
MathSAT MathSAT-5.2.12-Main default sat ✅ 26.21360 26.21600
SMTInterpol smtinterpol-2.1-118-g3dada2f default sat ✅ 25.52810 36.19050
veriT veriT-smtcomp2014 default unknown ❌ 2399.01000 2400.03000
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 5.48047 5.47417
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 47.67770 47.68380
SMT-COMP 2015 0.29 (5/7) CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 39.37890 39.39200
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 39.15670 39.17000
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 20.11050 20.11890
SMTInterpol SMTInterpol v2.1-206-g86e9531 default sat ✅ 18.59140 33.17200
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.55000
veriT veriT default unknown ❌ 2400.01000 2400.71000
Yices2 Yices default sat ✅ 6.78870 6.78997
Z3 z3 4.4.0 default sat ✅ 71.52740 71.55810
SMT-COMP 2016 0.38 (5/8) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 38.47340 38.49550
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 24.40170 24.41630
ProB ProB competition unknown ❌ 2400.06000 2401.17000
SMTInterpol smtinterpol-2.1-258-g92ab3df default sat ✅ 20.87110 40.77810
SMT-RAT SMT-RAT default unknown ❌ 2400.04000 2401.59000
veriT veriT-dev default unknown ❌ 2400.08000 2401.64000
Yices2 Yices-2.4.2 default sat ✅ 2.39640 2.39768
Z3 z3-4.4.1 default sat ✅ 106.30000 106.36500
SMT-COMP 2017 0.29 (5/7) CVC4 CVC4-smtcomp2017-main default sat ✅ 53.91800 53.92040
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 25.37960 25.37880
SMTInterpol SMTInterpol default sat ✅ 91.54470 112.53400
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.01100 599.93300
veriT veriT-2017-06-17 default unknown ❌ 600.03500 600.01300
Yices2 Yices2-Main default sat ✅ 6.62249 6.62188
Z3 z3-4.5.0 default sat ✅ 84.01000 83.99350
SMT-COMP 2018 0.25 (6/8) Ctrl-Ergo Ctrl-Ergo-SMTComp-2018_default sat ✅ 18.48120 73.22000
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 42.07020 42.06900
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 139.82700 139.82900
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default sat ✅ 24.99720 48.45750
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.04000 1200.07000
veriT veriT_default unknown ❌ 1200.08000 1199.98000
Yices2 Yices 2.6.0_default sat ✅ 6.71141 6.71074
Z3 z3-4.7.1_default sat ✅ 71.71150 71.70950
SMT-COMP 2019 0.25 (6/8) Ctrl-Ergo Ctrl-Ergo-2019-wrapped-sq_default sat ✅ 26.33730 104.42000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 37.00130 37.00110
CVC4-SymBreak_03_06_2019-wrapped-sq_default sat ✅ 89.29310 82.43130
Par4 Par4-wrapped-sq_default sat ✅ 2.39435 7.12000
ProB ProB-wrapped-sq_default unknown ❌ 2400.02000 2399.67000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default sat ✅ 37.79810 60.33790
veriT veriT-wrapped-sq_default unknown ❌ 2400.11000 2399.92000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 2.34567 2.34525
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 72.96870 72.96040
SMT-COMP 2021 0.29 (5/7) cvc5 cvc5-fixed_default sat ✅ 276.90800 276.83400
MathSAT mathsat-5.6.6_default sat ✅ 249.79500 249.74100
OpenSMT OpenSMT-fixed_default sat ✅ 431.99500 431.89300
Par4 Par4-wrapped-sq_default sat ✅ 4.40823 13.09000
SMTInterpol smtinterpol-2.5-823-g881e8631_default sat ✅ 69.36670 100.80200
veriT veriT_default unknown ❌ 1200.03000 1199.93000
Z3 z3-4.8.11_default unknown ❌ 1200.03000 1199.96000
SMT-COMP 2022 0.17 (5/6) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 289.06000 289.05200
MathSAT MathSAT-5.6.8_default sat ✅ 211.78200 211.74300
Par4 Par4-wrapped-sq_default sat ✅ 5.69104 16.78000
veriT veriT_default unknown ❌ 1200.07000 1199.95000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 6.10817 6.10665
Z3 z3-4.8.17_default sat ✅ 869.44600 869.26300
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 285.70400 285.65200
OpenSMT OpenSMT a78dcf01_default sat ✅ 598.87700 598.77500
Par4 Par4-wrapped-sq_default sat ✅ 6.67015 19.76000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default sat ✅ 55.82490 76.98200
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 5.77009 5.77042
Z3++ Z3++_sq_0526_default sat ✅ 24.19230 24.19090
SMT-COMP 2024 cvc5 cvc5 sat ✅ 176.04399 175.87119
OpenSMT OpenSMT sat ✅ 475.16740 475.05928
SMTInterpol SMTInterpol sat ✅ 34.13559 56.45552
Yices2 Yices2 sat ✅ 3.62602 3.52421
Z3alpha Z3-alpha sat ✅ 76.11344 75.97240