By Anonymous User
Review Details
Reviewer has chosen to be Anonymous
Overall Impression: Good
Content:
Technical Quality of the paper: Average
Originality of the paper: Yes, but limited
Adequacy of the bibliography: No
Presentation:
Adequacy of the abstract: Yes
Introduction: background and motivation: Limited
Organization of the paper: Needs improvement
Level of English: Satisfactory
Overall presentation: Good
Detailed Comments:
Review of Temporal Neuro-Symbolic Reasoning: From Architectures to Verifiable and Auditable Systems.
Capsule Summary
This paper analyzes temporal neurosymbolic reasoning through logical formalisms,
neurosymbolic integration, interpretability, and evaluation protocols.
It suggests a structured roadmap organized into maturity levels aimed at guiding the field toward verifiable systems.
The paper is clearly written, uses PRISMA 2020 guidelines, and contributes in organizing integration paradigms.
However, the survey contains a critical fundamental technical and historical flaw: it systematically omits the fundamental foundational body of work that established temporal neurosymbolic reasoning and learning as a research field.
Very specifically, the works developed in a dozen papers by Garcez, Lamb, Borges, and collaborators starting at NIPS 2003 and at least until 2014 is ignored.
This is not a light omission.
It concerns the papers that first demonstrated connectionist temporal logic, temporal knowledge learning in recurrent networks, temporal rule extraction, and agentic deployment of temporal neurosymbolic systems in applicable simulators (see IJCAI 2011, etc).
A survey claiming to cover 1980–2025 cannot be credible or published while ignoring this foundational literature.
Contributions
The integration typology on Logic => Network, Network => Logic, and Network <=> Logic is a useful guideline.
The work on STL robustness semantics and connection to differentiable temporal reasoning is technically sound.
The signed-distance interpretation in Figure 8 and the pipeline of Figure 9 are helpful.
The roadmap in Table 2 linking evaluation criteria, benchmark requirements, and control capabilities over maturity levels is clear.
These contributions are real but do not compensate for the omissions described above and further described below.
Critical Needed Change for a Survey Paper from 1980:
The omission of the foundational work directly related to the core of the paper;
these previous works were published in leading conferences and journals (NIPS/IJCAI/AAAI/IEEE TNN, etc, so they are easily accessible).
The survey fails to acknowledge, cite, or situate the pioneering work of Garcez, Lamb, Borges, and collaborators that created the field of temporal neurosymbolic AI.
Their work directly and clearly addressed the survey central research objectives.
Their work and was the first to do so in a grounded, implemented, and empirically validated manner (published not only at AI and Machine Learning venues, but also at the flagship International Conference on Software Engineering, IEEE TNN, and other venues).
Garcez and Lamb (NeurIPS-formerly NIPS 2003): established the foundational correspondence between temporal logic operators.
They already back in 2003 included past and future LTL modalities. They showed that key agent knowledge representation problems (muddy children puzzle, and others) could be reasoned about and learned in a neurosymbolic architecture. This is the foundational work on neurosymbolic temporal logic learning and reasoning. The work builds a connectionist architecture with soundness guarantees. This work was extended and the journal version with full results and extended examples has been published in Neural Computation: Artur S. d'Avila Garcez, Luís C. Lamb:
A Connectionist Computational Model for Epistemic and Temporal Reasoning. Neural Computation 18(7): 1711-1738 (2006).
The survey discusses connectionist temporal logic integration as if these foundational results did not exist. This is a crucial omission.
Lamb, Borges, and Garcez (AAAI 2007): introduced Sequential Connectionist Temporal Logic (SCTL), proving a correct correspondence between a fragment of LTL extended with past operators and NARX recurrent networks. The paper demonstrated temporal synchronization and learning (using the classical Dining Philosophers Problem as a testbed) within a unified connectionist model. It proved translation soundness and extracted temporal rules from trained networks.
This directly instantiates the Network <=> Logic integration mode the survey presents as a contemporary development (they did so back in 2007), with formal guarantees than most systems surveyed.
Not citing this work in a 2026 survey on neurosymbolic temporal reasoning is a scientific and academic omission or/and methodological error.
Borges, Garcez, and Lamb (IJCNN 2007): extended SCTL specifically to past temporal operators, demonstrating their connectionist implementation. The survey discusses past operators as a formal tool without acknowledging this prior implementation.
Borges, Garcez, and Lamb (ICANN 2010): provided the full neuralsymbolic cycle for temporal knowledge. It shows the translation of temporal logic programs into NARX networks. It shows how to perform (temporal) learning from examples and properties, and extraction of revised temporal logic programs. The survey Table 4 Network => Logic begins in 2016 with DT-STL, misrepresenting the history of the field by several years.
Borges, Garcez, Lamb, and Nuseibeh (ICSE 2011): applied SCTL (neurosymbolic) to software engineering. It integrates it with the NuSMV model checker in a cycle of verification, counter-example generation, and neural learning. It achieved in 2011 what the survey roadmap presents as a medium-term goal.
It is the first paper that showed that counterexamples cycle to neurosymbolic learning engine is a powerful methodology. Several papers are now using exactly the same principle for model refinement.
See e.g. David Harel, Assaf Marron, Ariel Rosenfeld, Moshe Y. Vardi, Gera Weiss:
Labor Division with Movable Walls: Composing Executable Specifications with Machine Learning and Search (Blue Sky Idea). AAAI 2019: 9770-9774.
Borges, Garcez, and Lamb (IEEE Transactions on Neural Networks 2011): is the journal consolidation of the SCTL neurosymbolic temporal learning and reasoning methodology and program. It presents formal semantics, soundness, gradient-based temporal learning, pedagogical extraction, and model checking integration, that can be applied and has been applied in software engineering and beyond. Its omission from a survey of 1980–2025 coverage cannot be justified by any selection criterion.
de Penning, Garcez, Lamb, and Meyer (IJCAI 2011): built directly on SCTL to implement the first deployed agentic system capable of online temporal reasoning and learning. Directly anticipates the survey long-term autonomy goals stated in the roadmap.
de Penning, Garcez, Lamb, Stuiver, and Meyer (IJCNN 2014): deploys the temporal neurosymbolic cognitive agent in intelligent transportation, reducing CO2 emissions. Demonstrates real-world scalability over a decade before the survey roadmap identifies as a future goal.
Survey omissions and claims:
These omissions materially impact the validity of specific claims.
The survey situates STLnet (2020) and T-LEAF (2021) as early exemplars of tight neurosymbolic integration.
However, while SCTL achieved provably sound integration of temporal semantics with differentiable neural computation in 2007. It was extended at least until 2014.
Therefore, chronological starting points of all appendix tables are incorrect given the omitted literature.
The roadmap presents isolated and a posteriori inspectable temporal reasoning as a short-term goal to be built, however the SCTL framework implemented exactly this in 2010. The medium-term goal of architectures directly integrating temporal constraints with abductive correction was achieved by Borges et al. 2011 through counter-example-driven iterative learning with the model checker NuSMV.
Presenting these as open directions, while ignoring their prior achievement, misrepresents past scientific contributions.
The survey cites Garcez and Lamb (2020) as a conceptual reference, while ignoring the same authors previous temporal neurosymbolic work.
The 2020 paper summarizes and builds upon the omitted foundations.
The PRISMA selection process may have a systematic bias toward post 2015 publications, even though the authors stated 1980–2025 timeframe. Maybe the bias/use of certain techniques to write the survey inadvertently penalized foundational papers with a terminology different from the authors use of terms.
SUGGESTED DECISION:
Major Revision Required
In a survey, the omission of the Garcez-Lamb-Borges foundational program (published in leading venues, therefore accessible) is a structural deficiency.
It directly affetcs the historical framing, the chronological history/inventory, the roadmap of open problems, and the survey's credibility as a comprehensive paper.
REQUIRED CHANGES: The literature mentioned is based on foundational papers, not random selections.
The original contributions of such an important field must be acknowledged in a comprehensive peer-reviewed academic survey.
Garcez and Lamb, NeurIPS 2003: should be credited as establishing the first soundness-guaranteed connectionist temporal logic framework. This is one of the foundational papers of the field.
Lamb, Borges, and Garcez, AAAI 2007: should be credited as establishing foundations and evaluation of SCTL and the bidirectional integration of LTL and NARX networks with formal proofs and validation in temporal synchronisation, reasoning and learning.
Borges, Garcez, and Lamb, IJCNN 2007: connectionist treatment of past temporal logic operators learning.
Borges, Garcez, and Lamb, ICANN 2010: complete neural-symbolic cycle for temporal knowledge including rule extraction.
Borges, Garcez, Lamb, and Nuseibeh, ICSE 2011: first integration of temporal neuro-ymbolic learning with a formal model checker in a software engineering pipeline, using the now deployed technique of fully automated model refinement using counter-examples to inform learning.
Borges, Garcez, and Lamb, IEEE Transactions on Neural Networks 2011: definitive formal treatment of SCTL with soundness proofs and empirical validation using software engineerig research benchmarks.
de Penning, Garcez, Lamb, and Meyer, IJCAI 2011: first sound deployed agentic temporal neurosymbolic system.
de Penning, Garcez, Lamb, Stuiver, and Meyer, IJCNN 2014: first real-world application of temporal neurosymbolic agents to reduce CO2 emissions.
On non-classical logics: Garcez and Lamb wrote a piper titled "Neural-symbolic systems and the case for non-classical reasoning', where they argued the case for several non-classical logics in neurosymbolic and machine learning. They explicitly mentioned temporal, intuitionistic, and modal logics as key to the development of sound neurosymbolic systems.
Artur S. d'Avila Garcez, Luis C. Lamb:
Neural-Symbolic Systems and the Case for Non-Classical Reasoning. We Will Show Them! (1) 2005: 469-488.
Their subsequent monograph, called a landmark in neurosymbolic AI by Gary Marcus consolidated the case for non-classical reasoning and learning:
Artur S. d'Avila Garcez, Luis C. Lamb, Dov M. Gabbay:
Neural-Symbolic Cognitive Reasoning. Cognitive Technologies, Springer 2009. Easily accessible and highly cited literature.
This work presents ''self-contained presentation of neural network models for a number of logics, including modal, temporal, and epistemic logic." Thus, temporal and non-classical neurosymbolic methods are already mentioned in the book.
Table corrections:
Table 3 (Logic => Network) include SCTL-based approaches from 2007 onward as early examples of the integration mode.
Revise Table 4 (Network => Logic) to begin its chronological information to 2010, correcting the current 2016 starting point which misrepresents the field's history by six years.
Revise Table 5 (Bidirectional) to include SCTL from 2007 as the first bidirectional framework with formal soundness guarantees.
Include a row or comment in each table explicitly positioning the SCTL neurosymbolic system relative to current approaches on key dimensions: formal guarantees, differentiability, scalability, and empirical validation (SCTL has been validated in practice and their system pioneered a cycle used today in software engineering research).
Roadmap revisions
Revise short-term foundations section to acknowledge that inspectable temporal reasoning with rule extraction was shown first in 2010–2011.
Reframe the short-term goal as reproducibility and standardization of this capability rather than its initial establishment.
Revise the medium-term integration section to acknowledge that iterative verification-learning cycles with model checkers were implemented back in 2011, and reframe the goal.
Revise the long-term autonomy section to acknowledge that agentic online temporal neurosymbolic learning was demonstrated in 2011, and deployed in 2014, distinguishing genuinely open challenges from already-achieved milestones and proofs of concepts.
Historical academic/scientific framing:
Rewrite the introduction to fairly and historically represent that bidirectional integration of temporal logic and recurrent neural networks with soundness proofs was achieved in 2007-2011, and not in the 2020s.
Revise the integration typology section to position the SCTL program as the first formally sound instantiation of the Network <==> Logic.
Revise claims about STLnet (2020) and T-LEAF (2021) as pioneering integration approaches to reflect their relationship to prior foundational work from Neurips/NIPS 2003, AAAI2007, IEEE TNN 2011, Neural Computation, etc by Garcez et al.
Methodology adopted:
Review if PRISMA somewhat penalized foundational papers with pre-2015/2020 terminology. Describe any corrective measures.
Verify the 1980–2025 period coverage against the actual distribution of retained papers; correct bias towards recent publications.
The specific required changes (add the listed papers to tables/roadmap/introdction, corrected chronology and open challenges, potential PRISMA bias are necessary for the paper to be academic credible/publishable as a 2026 survey.