Benchmark

non-incremental/AUFLIRA/nasa/fol_simplify_structure_forall/quaternion_ds1_init_0028.fof.smt2 

NASA benchmarks from "Using Automated Theorem Provers to Certify Auto-generated
Aerospace Software", IJCAR 2004.  Translated from TPTP format by Yeting Ge and
Clark Barrett
Benchmark
Size8976
Compressed Size2018
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2006-08-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 8968
Compressed Size2030
Max. Term Depth20
Asserts 14
Declared Functions21
Declared Constants14
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not3 and94 =>28 =37
forall24 let8 Int94 Real19
+1 -4 <3 <=50
>=46 Array32 select98 store2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.25 (3/4) CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.01922 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.01840 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.01768 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.02244 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.01978 —
veriT veriT-SMT-EVAL-2013 default unknown ❌ 1060.40000 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.01710 —
Z3-SMT-COMP-2011 default unsat ✅ 0.02616 —
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.02877 0.01700
CVC4 CVC4 f7118b2 default unsat ✅ 0.03420 0.01900
veriT veriT-smtcomp2014 default unknown ❌ 108.56100 108.57300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.01731 0.01600
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.01745 0.01700
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.02466 0.02200
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.02557 0.02300
veriT veriT default unknown ❌ 1234.33000 1234.50000
Z3 z3 4.4.0 default unsat ✅ 0.03938 0.03899
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.02972 0.03000
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 6.01952 6.04558
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.18073 0.08870
veriT veriT-dev default unknown ❌ 2400.02000 2401.30000
Z3 z3-4.4.1 default unsat ✅ 0.03957 0.04077
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.03327 0.03205
Vampire vampire4.2-smt vampire unsat ✅ 0.06039 0.05741
veriT veriT-2017-06-17 default unknown ❌ 600.02000 599.98000
Z3 z3-4.5.0 default unsat ✅ 0.04223 0.04150
SMT-COMP 2018 0.20 (4/5) Alt-Ergo Alt-Ergo-SMTComp-2018_default unsat ✅ 0.05801 0.08610
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.03457 0.03481
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.09108 0.16193
veriT veriT_default unknown ❌ 1200.05000 1199.89000
Z3 z3-4.7.1_default unsat ✅ 0.04307 0.04301
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.04186 0.04321
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.03861 0.03894
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 0.04066 0.04100
Par4 Par4-wrapped-sq_default unsat ✅ 0.02348 0.00591
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2170.42000 4099.53000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.29793 3.46130
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.18636 3.31333
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.46376 3.46529
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.58267 0.42915
veriT veriT-wrapped-sq_default unknown ❌ 2400.04000 2399.79000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.04520 0.04517
z3-4.7.1_default unsat ✅ 0.04458 0.04455
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 0.04269 0.04298
cvc5 cvc5-fixed_default unsat ✅ 0.04070 0.04123
Par4 Par4-wrapped-sq_default unsat ✅ 0.02427 0.00660
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.13000 1332.27000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.91104 4.83808
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.36700 0.25399
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.16898 0.16309
veriT veriT_default unknown ❌ 1200.02000 1200.05000
Z3 z3-4.8.11_default unsat ✅ 0.02864 0.02860
z3-4.8.8_default unsat ✅ 0.04302 0.04296
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.31436 0.18815
iProver iProver v3.9.3 unsat ✅ 13.46682 44.49268
SMTInterpol SMTInterpol unknown ❌ 767.61391 2028.51908
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.01317 4.30719