Benchmark

non-incremental/AUFLIRA/nasa/fol_simplify_structure_prop/quaternion_ds1_inuse_0035.fof.smt2

NASA benchmarks from "Using Automated Theorem Provers to Certify Auto-generated
Aerospace Software", IJCAR 2004.  Translated from TPTP format by Yeting Ge and
Clark Barrett
Benchmark
Size8242
Compressed Size1787
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2006-08-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 8234
Compressed Size1791
Max. Term Depth35
Asserts 14
Declared Functions21
Declared Constants10
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 and84 =>15 =52
forall15 let9 Int78 Real19
-4 <=32 >1 >=28
Array32 select114 store6

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.25 (3/4) CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.02119
CVC3-SMT-COMP-2011 default unsat ✅ 0.02286
CVC3-SMT-COMP-2012 default unsat ✅ 0.02460
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unsat ✅ 0.02544
veriT veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.01653
Z3-SMT-COMP-2011 default unsat ✅ 0.02516
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.02761 0.01900
CVC4 CVC4 f7118b2 default unsat ✅ 0.03563 0.02499
veriT veriT-smtcomp2014 default unknown ❌ 168.10900 168.11700
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.02512 0.01600
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.02041 0.02000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.02876 0.02600
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.02965 0.02600
veriT veriT default unknown ❌ 1332.07000 1332.13000
Z3 z3 4.4.0 default unsat ✅ 0.03933 0.03899
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.03653 0.03674
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 11.13310 11.18680
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.07289 0.07288
veriT veriT-dev default unknown ❌ 2400.02000 2401.33000
Z3 z3-4.4.1 default unsat ✅ 0.03933 0.04100
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.04374 0.04363
Vampire vampire4.2-smt vampire unsat ✅ 0.09953 0.09800
veriT veriT-2017-06-17 default unknown ❌ 600.02600 599.90000
Z3 z3-4.5.0 default unsat ✅ 0.04746 0.04056
SMT-COMP 2018 0.40 (3/5) Alt-Ergo Alt-Ergo-SMTComp-2018_default unsat ✅ 0.07284 0.14328
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.04509 0.04532
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.07000 4773.67000
veriT veriT_default unknown ❌ 1200.02000 1199.87000
Z3 z3-4.7.1_default unsat ✅ 0.04282 0.04274
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.05600 0.05677
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.07934 0.07968
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 0.08410 0.08444
Par4 Par4-wrapped-sq_default unsat ✅ 0.02569 0.00673
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 675.71600 1935.06000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.61884 3.70648
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.36808 3.74011
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.14302 3.33315
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 22.91260 89.97000
veriT veriT-wrapped-sq_default unknown ❌ 2400.03000 2399.71000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.04641 0.04641
z3-4.7.1_default unsat ✅ 0.04426 0.04422
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 0.14173 0.14196
cvc5 cvc5-fixed_default unsat ✅ 0.10181 0.10233
Par4 Par4-wrapped-sq_default unsat ✅ 0.02390 0.00611
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.07000 3968.69000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.99650 4.85684
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 52.00960 178.04000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 51.37160 174.28000
veriT veriT_default unknown ❌ 1200.04000 1199.99000
Z3 z3-4.8.11_default unsat ✅ 0.02880 0.02877
z3-4.8.8_default unsat ✅ 0.04361 0.04358
SMT-COMP 2022 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.07499 0.07528
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.10937 0.10978
SMTInterpol smtinterpol-fixed-2.5-1148-gf2d8e6b0_default unknown ❌ 1200.06000 1282.02000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.10045 6.02986
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 32.14830 127.24000
veriT veriT_default unknown ❌ 1200.03000 1199.72000
Z3 z3-4.8.17_default unsat ✅ 0.02792 0.02972
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 0.27643 0.17668
iProver iProver v3.9 unknown ❌ 1201.73716 4743.39993
SMTInterpol SMTInterpol unknown ❌ 1202.73313 1726.46147
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.32936 0.20923
iProver iProver v3.9.3 unknown ❌ 1201.80116 4760.46324
SMTInterpol SMTInterpol unknown ❌ 237.05447 867.39293
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.96055 3.99913