*Result*: Simulation modeling of an analog impulse neural network based on a memristor crossbar using parallel computing technologies ; Имитационное моделирование аналоговой импульсной нейронной сети на основе мемристорного кроссбара с использованием параллельных вычислительных технологи
Title:
Simulation modeling of an analog impulse neural network based on a memristor crossbar using parallel computing technologies ; Имитационное моделирование аналоговой импульсной нейронной сети на основе мемристорного кроссбара с использованием параллельных вычислительных технологи
Authors:
Contributors:
This work was supported by RFBR grant no. 19-29-03051 mk., Работа выполнена при поддержке гранта РФФИ № 19-29-03051 мк.
Source:
Izvestiya Vysshikh Uchebnykh Zavedenii. Materialy Elektronnoi Tekhniki = Materials of Electronics Engineering; Том 25, № 4 (2022); 288-297 ; Известия высших учебных заведений. Материалы электронной техники; Том 25, № 4 (2022); 288-297 ; 2413-6387 ; 1609-3577 ; 10.17073/1609-3577-2022-4
Publisher Information:
MISIS
Publication Year:
2023
Collection:
Materials of Electronics Engineering (E-Journal) / Известия высших учебных заведений. Материалы электронной техники
Subject Terms:
Document Type:
*Academic Journal*
article in journal/newspaper
File Description:
application/pdf
Language:
Russian
Relation:
https://met.misis.ru/jour/article/view/513/394; Merolla P.A., Arthur J.V., Alvarez-Icaza R., Cassidy A.S., Sawada J., Akopyan F., Jackson B.L., Imam N., Guo Ch., Nakamura Y., Brezzo B., Vo I., Esser S.K., Appuswamy R., Taba B., Amir A., Flickner M.D., Risk W.P., Manohar R., Modha Dh.S. Artificial brains. A million spiking-neuron integrated circuit with a scalable communication network and interface. Science. 2014; 345(6197): 668—673. https://doi.org/10.1126/science.1254642; Wong H.-S.P., Lee H.-Y., Yu Sh., Chen Y.-Sh., Wu Y., Chen P.-Sh., Lee B., Chen F.T., Tsai M.-J. Metal-oxide RRAM. Proceedings of the IEEE. 2012; 100(6): 1951—1970. https://doi.org/10.1109/JPROC.2012.2190369; Yang J.J., Strukov D.B., Stewart D.R. Memristive devices for computing. Nature Nanotechnology. 2013; 8(1): 13—24. https://doi.org/10.1038/nnano.2012.240; Li C., Hu M., Li Y., Ge N., Montgomery E., Zhang J., Song W., Dávila N., Graves C.E., Li Zh., Strachan J.P., Lin P., Wang Zh., Barnell M., Wu Q., Williams R.S., Yang J.J., Xia Q. Analogue signal and image processing with large memristor crossbars. Nature Electronics. 2018; 1: 52—59. https://doi.org/10.1038/s41928-017-0002-z; Morozov A.Yu., Abgaryan K.K., Reviznikov D.L. Mathematical model of a neuromorphic network based on memristive elements. Chaos, Solitons & Fractals. 2021; 143: 110548. https://doi.org/10.1016/j.chaos.2020.110548; Морозов А.Ю., Абгарян К.К., Ревизников Д.Л. Математическое моделирование самообучающейся нейроморфной сети, основанной на наноразмерных мемристивных элементах с 1T1R-кроссбар-архитектурой. Известия высших учебных заведений. Материалы электронной техники. 2020; 23(3): 186—195. https://doi.org/10.17073/1609-3577-2020-3-186-195; Diehl P., Cook M. Unsupervised learning of digit recognition using spike-timing-dependent plasticity. Frontiers in Computational Neuroscience. 2015; 9: 99. https://doi.org/10.3389/fncom.2015.00099; Ambrogio S., Balatti S., Milo V., Carboni R., Wang Zh., Calderoni A., Ramaswamy N., Ielmini D. Neuromorphic learning and recognition with one-transistor-one-resistor synapses and bistable metal oxide RRAM. IEEE Transactions on Electron Devices. 2016; 63(4): 1508—1515. https://doi.org/10.1109/TED.2016.2526647; Guo Y., Wu H., Gao B., Qian H. Unsupervised learning on resistive memory array based spiking neural networks. Frontiers in Neuroscience. 2019; 13: 812. https://doi.org/10.3389/fnins.2019.00812; OpenMP. URL: https://www.openmp.org/ (дата обращения: 02.04.2021).; PVS-Studio is a static analyzer on guard of code quality, security (SAST), and code safety. URL: https://pvs-studio.com/ru/a/0057/ (дата обращения 02.04.2021).; Rodriguez-Fernandez A., Cagli C., Perniola L., Miranda E., Suñé J. Characterization of HfO2-based devices with indication of second order memristor effects. Microelectronic Engineering. 2018; 195: 101—106. https://doi.org/10.1016/j.mee.2018.04.006; Теплов Г.С., Горнев Е.С. Модель на языке Verilog-A многоуровневого биполярного мемристора с учетом девиаций параметров переключения. Микроэлектроника. 2019; 48(3): 163—175. https://doi.org/10.1134/S0544126919030104; Васильев А., Чернов П.С. Математическое моделирование мемристора в присутствии шума. Математическое моделирование. 2014; 26(1): 122—132.; Morozov A.Yu., Abgaryan K.K., Reviznikov D.L. Simulation of the neuromorphic network operation taking into account stochastic effects. In: Short paper proceed. of the VI Inter. conf. on information technologies and high-performance computing (ITHPC 2021). Khabarovsk, 14–16 September 2021. CEUR Workshop Proceedings; 2021. P. 84—91.; Морозов А.Ю., Абгарян К.К., Ревизников Д.Л. Математическое моделирование аналоговой самообучающейся нейронной сети на основе мемристивных элементов с учетом стохастической динамики переключения. Российские нанотехнологии. 2021; 16(6): 76—86. https://doi.org/10.1134/S1992722321060157; Morozov A.Yu., Abgaryan K.K., Reviznikov D.L. Interval model of a memristor crossbar network. Physica Status Solidi (B). 2022; 259(11): 2200150. https://doi.org/10.1002/pssb.202200150; Морозов А.Ю., Ревизников Д.Л. Интервальный подход к решению задач параметрической идентификации динамических систем. Дифференциальные уравнения. 2022; 58(7): 962—976. https://doi.org/10.31857/S0374064122070081; Mladenov V. Analysis of memory matrices with HfO2 memristors in a PSpice environment. Electronics. 2019; 8(4): 383. https://doi.org/10.3390/electronics8040383; Zheng G., Mohanty S.P., Kougianos E., Okobiah O. Polynomial metamodel integrated Verilog-AMS for memristor-based mixed-signal system design. Proceed. IEEE 56th Inter. midwest symposium on circuits and systems (MWSCAS). Columbus, OH, 04 August 2013. Demand Purchase at Partner; 2013. P. 916—919. https://doi.org/10.1109/MWSCAS.2013.6674799; Martyshov M.N., Emelyanov A.V., Demin V.A., Nikiruy K.E., Minnekhanov A.A., Nikolaev S.N., Taldenkov A.N., Ovcharov A.V., Presnyakov M.Yu., Sitnikov A.V., Vasiliev A.L., Forsh P.A., Granovsky A.B., Kashkarov P.K., Kovalchuk M.V., Rylkov V.V. Multifilamentary character of anticorrelated capacitive and resistive switching in memristive structures based on (Co-Fe-B)x(LiNbO3)100-x nanocomposite. Physical Review Applied. 2020; 14(3): 034016. https://doi.org/10.1103/PhysRevApplied.14.034016; Rylkov V., Nikolaev S., Demin V., Emelyanov A.V., Nikiruy K.E., Levanov V.A., Presnyakov M.Y., Taldenkov A.N., Vasiliev A.L., Chernoglazov K.Y., Tugushev V.V., Sitnikov A.V., Kalinin Y.E., Bugaev A.S., Granovsky A.B., Vedeneev A.S. Transport, magnetic, and memristive properties of a nanogranular (CoFeB)x(LiNbOy)100-x composite material. Journal of Experimental and Theoretical Physics. 2018; 126(3): 353—367. https://doi.org/10.1134/S1063776118020152; Фотохостинг Pinterest. URL: https://ru.pinterest.com/pin/351912463120005/ (дата обращения: 02.09.2022).; https://met.misis.ru/jour/article/view/513
DOI:
10.17073/1609-3577-2022-4-288-297
Availability:
Rights:
Authors who publish with this journal agree to the following terms:Authors retain copyright and grant the journal right of first publication with embargo 1 year, then the work will be licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access). ; Авторы, публикующие статьи в данном журнале, соглашаются на следующее:Авторы сохраняют за собой автороские права и предоставляют журналу право первой публикации работы, которая по истечении 12 месяцев после публикации автоматически лицензируется на условиях Creative Commons Attribution License , которая позволяет другим распространять данную работу с обязательным сохранением ссылок на авторов оригинальной работы и оригинальную публикацию в этом журнале.Авторы имеют право размещать их работу в сети Интернет (например в институтском хранилище или персональном сайте) до и во время процесса рассмотрения ее данным журналом, так как это может привести к продуктивному обсуждению и большему количеству ссылок на данную работу (См. The Effect of Open Access).
Accession Number:
edsbas.DAB4EAD3
Database:
BASE
*Further Information*
*The work is devoted to the issues of simulation modeling of an analog impulse neural network based on memristive elements within the framework of the problem of pattern recognition. Simulation modeling allows you to configure the network at the level of a mathematical model, and subsequently use the obtained parameters directly in the process of operation. The network model is given as a dynamic system, which can consist of tens and hundreds of thousands of ordinary differential equations. Naturally, there is a need for an efficient and parallel implementation of an appropriate simulation model. OpenMP (Open Multi-Processing) is used as a technology for parallelizing calculations, since it allows you to easily create multi-threaded applications in various programming languages. The efficiency of parallelization is evaluated on the problem of modeling the process of learning the network to recognize a set of five images of size 128 by 128 pixels, which leads to the solution of about 80 thousand differential equations. On this problem, more than a sixfold acceleration of calculations was obtained.According to experimental data, the character of memristor operation is stochastic, as evidenced by the spread in the current-voltage characteristics during switching between high-resistance and low-resistance states. To take this feature into account, a memristor model with interval parameters is used, which gives upper and lower limits on the quantities of interest, and encloses the experimental curves in corridors. When modeling the operation of the entire analog self-learning impulse neural network, each epoch of training, the parameters of the memristors are set randomly from the selected intervals. This approach makes it possible to do without the use of a stochastic mathematical apparatus, thereby further reducing computational costs. ; Работа посвящена вопросам имитационного моделирования аналоговой импульсной нейронной сети на основе мемристивных элементов в рамках задачи распознавания образов. Имитационное ...*