Distance calculation is always one of the most important goals in a digital stereoscopic vision system. In an AER system this goal is very important too, but it cannot be calculated as accurately as we would like. This demonstration shows a first approximation in this field, using a disparity algorithm between both retinas. The system can make a distance approach about a moving object, more specifically, a qualitative estimation. Taking into account the stereo vision system features, the previous retina positioning and the very important Hold&Fire building block, we are able to make a correlation between the spike rate of the disparity and the distance.
Multisensory integration is commonly used in various robotic areas to collect much more information from an environment using different and complementary types of sensors. This demonstration presents a scenario where the motor rotation frequency is obtained using an AER DVS128 retina chip (Dynamic Vision Sensor) and a frequency decomposer auditory system on a FPGA that mimics a biological cochlea. Both of them are spike-based sensors with Address-Event-Representation (AER) outputs. A new AER monitor hardware interface, based on a Spartan-6 FPGA, allows two operational modes: real-time (up to 5 Mevps through USB2.0) and off-line mode (up to 20 Mevps and 33.5 Mev stored in DDR RAM). The sensory integration allows the bio-inspired cochlea limit to provide a concrete range of rpm approaches, which are obtained by the silicon retina.
Image processing in digital computer systems usually considers the visual information as a sequence of frames. These frames are from photographs that capture reality for a short period of time. They are renewed and transmitted at a rate of 25–30 frames per second, in a typical real-time scenario. Each of these frames needs to be filtered and processed in order to detect a feature on it. This processing is usually based on very expensive operations in terms of resource consumption (processor resources and processing time) for an efficient real-time application. In contrast, neuro-inspired systems, which work in a manner similar to the nervous system, may resolve those and others more complex problems, such as visual recognition in real-time. The spike-based philosophy for visual information processing based on the neuro-inspired Address-Event-Representation (AER) is achieving nowadays very high performances. Address-Event-Representation (AER) is a neuromorphic interchip communication protocol that allows for real-time virtual massive connectivity between huge numbers of neurons located on different chips. When building multi-chip muti-layered AER systems it is absolutely necessary to have a computer interface that allows (a) to read AER interchip traffic into the computer and visualize it on screen, and (b) convert conventional frame-based video stream in the computer into AER and inject it at some point of the AER structure. This is necessary for test and debugging of complex AER systems. A set of software methods for converting digital frames into AER format are present in the literature. In this work we study the low level performance lacks of these methods monitoring internal performance hardware counters for an Intel Core 2 Quad. We discuss the results obtained and we propose improvements for those software methods that did not achieve real-time properties.
Background: Cervical cancer is caused in the vast majority of cases by the human papillomavirus through sexual contact and requires a specific analysis with specialised equipment and health professionals to be detected. However, its incidence is up to ten times higher in areas without such resources. To overcome these shortcomings and perform mass screening, classifiers based on convolutional neural networks are being developed and, to speed up sample collection, liquid cytology samples have been used in recent years. Even so, these systems are not infallible and require verification by a healthcare professional to make a final diagnosis, which is why explainable deep learning techniques are taking advantage in this area.Objective: In this work, we perform an exhaustive analysis of the classifier systems developed in recent years and develop our own classifier through the evaluation of multiple combinations and the detailed adjustment of the system's hyperparameters.Methods: The classifiers developed (for two and four classes following the Bethesda System nomenclature) are evaluated in depth and compared with the works published in the last five years in terms of both efficiency and computational cost. Moreover, a complementary report generation system is presented which, in addition to the classifier results, provides the healthcare professional a detailed report containing the classification confidence of each of the categories and the visual annotation on the original image of the area (or areas) where the classifier has been focused to obtain its results.Results: The results determine an accuracy close to 98\% for the four-class classifier (with no false positives for the negative class) and 100\% for the two-class classifier. The final report include a detailed confidence list and a heat map containing the regions of interest used by the system to classify the given image.Conclusions: Compared to the previous works, this classifier obtains better accuracy results with lower computational cost. Moreover, the use of Explainable Artificial Intelligence techniques is an useful tool for the healthcare professional, as it determines the confidence in the results and the areas of the image used for classification, which can be used for an incremental learning process (allowing the professional to point out the areas he/she thinks are most important and cross-checking them against those detected by the system).