Benchmark

non-incremental/AUFLIRA/nasa/fol_simplify_structure_prop/quaternion_ds1_symm_0020.fof.smt2 

NASA benchmarks from "Using Automated Theorem Provers to Certify Auto-generated
Aerospace Software", IJCAR 2004.  Translated from TPTP format by Yeting Ge and
Clark Barrett
Benchmark
Size9361
Compressed Size2018
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2006-08-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 9353
Compressed Size2022
Max. Term Depth44
Asserts 14
Declared Functions21
Declared Constants6
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 and54 =>15 =25
forall15 let45 Int78 Real19
-4 <=31 >=27 Array32
select129 store72

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.50 (2/4) CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.06048 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.06061 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.05625 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
veriT veriT-SMT-EVAL-2013 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.01904 —
Z3-SMT-COMP-2011 default unsat ✅ 0.02830 —
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.06567 0.05699
CVC4 CVC4 f7118b2 default unsat ✅ 0.07128 0.05999
veriT veriT-smtcomp2014 default unknown ❌ 2399.01000 2400.04000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.02650 0.01900
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.05787 0.05699
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.05678 0.05399
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.05643 0.05399
veriT veriT default unknown ❌ 2400.01000 2400.89000
Z3 z3 4.4.0 default unsat ✅ 0.04076 0.04099
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.04126 0.04144
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 1.18246 1.18812
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.06454 0.06415
veriT veriT-dev default unknown ❌ 2400.01000 2401.37000
Z3 z3-4.4.1 default unsat ✅ 0.03954 0.04073
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.04840 0.04417
Vampire vampire4.2-smt vampire unsat ✅ 0.07877 0.07628
veriT veriT-2017-06-17 default unknown ❌ 600.05900 599.97600
Z3 z3-4.5.0 default unsat ✅ 0.04327 0.04260
SMT-COMP 2018 0.40 (3/5) Alt-Ergo Alt-Ergo-SMTComp-2018_default unsat ✅ 0.82668 3.13000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.04847 0.04871
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.08000 4776.23000
veriT veriT_default unknown ❌ 1200.05000 1200.08000
Z3 z3-4.7.1_default unsat ✅ 0.04368 0.04358
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.84761 2.98000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.04921 0.04955
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 0.05141 0.05173
Par4 Par4-wrapped-sq_default unsat ✅ 0.02532 0.00578
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.08000 7062.56000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.40460 3.42581
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.14849 3.48263
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.33640 3.52391
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.24500 0.18790
veriT veriT-wrapped-sq_default unknown ❌ 2400.03000 2399.92000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.04631 0.04629
z3-4.7.1_default unsat ✅ 0.04516 0.04510
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.05253 0.05287
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.07122 0.07179
SMTInterpol smtinterpol-fixed-2.5-1148-gf2d8e6b0_default unsat ✅ 0.94292 2.34885
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.91028 4.86463
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.14843 0.13969
veriT veriT_default unknown ❌ 1200.02000 1199.90000
Z3 z3-4.8.17_default unsat ✅ 0.02940 0.03120
SMT-COMP 2023 0.40 (3/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.04662 0.04716
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.07050 0.07103
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.06000 4746.26000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 0.92053 2.48182
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.95989 4.89874
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.15629 0.15363
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 0.23751 0.13795
iProver iProver v3.9 unknown ❌ 1201.73407 4748.50537
SMTInterpol SMTInterpol unsat ✅ 0.90410 2.24622
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.27039 0.15269
iProver iProver v3.9.3 unknown ❌ 1201.78707 4760.19620
SMTInterpol SMTInterpol unknown ❌ 1201.65655 1932.44728
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.02790 4.33714