Neurosymbolic Routing for Reliable Reasoning on Resource-Constrained Edge Devices

Running a language model on edge hardware provides private and low-latency reasoning without a network connection, and yet the small models that fit on such devices are unreliable on the tasks computers are expected to handle well, such as arithmetic, algebra, and formal logic problems. We argue tha