Benchmark

non-incremental/AUFNIRA/nasa/fol_simplify/cl5_nebula_norm_0007.fof.smt2 

NASA benchmarks from "Using Automated Theorem Provers to Certify Auto-generated
Aerospace Software", IJCAR 2004.  Translated from TPTP format by Yeting Ge and
Clark Barrett
Benchmark
Size7875
Compressed Size1834
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2006-08-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 7867
Compressed Size1849
Max. Term Depth18
Asserts 14
Declared Functions21
Declared Constants13
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not3 and53 =>16 =27
forall15 let12 Int75 Real19
-6 *23 <=30 >=26
exp5 sqrt3 Array32 select95

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2011 CVC3 CVC3 v2.4 unsat ✅ — —
Z3 Z3 unsat ✅ — —
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.02207 —
CVC3-SMT-COMP-2011 default unsat ✅ 0.02041 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.02191 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.01690 —
Z3-SMT-COMP-2011 default unsat ✅ 0.02587 —
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.02743 0.01900
CVC4 CVC4 f7118b2 default unsat ✅ 0.02799 0.01700
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.02472 0.01600
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.01989 0.01900
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.02472 0.02200
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.02473 0.02200
Z3 z3 4.4.0 default unsat ✅ 0.03893 0.03899
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.03007 0.03065
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.99703 1.00169
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.89108 1.25896
Z3 z3-4.4.1 default unsat ✅ 0.03888 0.03985
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.03136 0.03100
Vampire vampire4.2-smt vampire unsat ✅ 0.18152 0.40361
Z3 z3-4.5.0 default unsat ✅ 0.03998 0.03992
SMT-COMP 2018 Alt-Ergo Alt-Ergo-SMTComp-2018_default unsat ✅ 0.05906 0.08601
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.03413 0.03437
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 2.16689 8.36000
Z3 z3-4.7.1_default unsat ✅ 0.04215 0.04207
SMT-COMP 2019 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.04707 0.04719
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.03914 0.03948
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.03740 0.03773
Par4 Par4-wrapped-sq_default unsat ✅ 0.04534 0.00600
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.50506 3.60158
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.25853 2.89040
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 5.40102 20.08000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.04560 0.04560
SMT-COMP 2020 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.04184 0.04358
CVC4 CVC4-sq-final_default unsat ✅ 0.04011 0.04041
Par4 Par4-wrapped-sq_default unsat ✅ 0.04866 0.00929
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.51738 3.64282
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.17210 0.08942
Z3 z3-4.8.8_default unsat ✅ 0.04075 0.04072
SMT-COMP 2023 0.25 (3/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.04216 0.04272
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.06803 0.06845
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 65.73660 255.89000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.03311 4.97141
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.16060 0.14174