{"id":"https://openalex.org/W2022933888","doi":"https://doi.org/10.1002/scj.4690260605","title":"Analysis of the error back\u2010propagation learning algorithms with gain","display_name":"Analysis of the error back\u2010propagation learning algorithms with gain","publication_year":1995,"publication_date":"1995-01-01","ids":{"openalex":"https://openalex.org/W2022933888","doi":"https://doi.org/10.1002/scj.4690260605","mag":"2022933888"},"language":"en","primary_location":{"id":"doi:10.1002/scj.4690260605","is_oa":false,"landing_page_url":"https://doi.org/10.1002/scj.4690260605","pdf_url":null,"source":{"id":"https://openalex.org/S58208175","display_name":"Systems and Computers in Japan","issn_l":"0882-1666","issn":["0882-1666","1520-684X"],"is_oa":false,"is_in_doaj":false,"is_core":true,"host_organization":"https://openalex.org/P4310320595","host_organization_name":"Wiley","host_organization_lineage":["https://openalex.org/P4310320595"],"host_organization_lineage_names":["Wiley"],"type":"journal"},"license":null,"license_id":null,"version":"publishedVersion","is_accepted":true,"is_published":true,"raw_source_name":"Systems and Computers in Japan","raw_type":"journal-article"},"type":"article","indexed_in":["crossref"],"open_access":{"is_oa":false,"oa_status":"closed","oa_url":null,"any_repository_has_fulltext":false},"authorships":[{"author_position":"first","author":{"id":"https://openalex.org/A5064247626","display_name":"Qi Jia","orcid":"https://orcid.org/0000-0001-8537-9328"},"institutions":[{"id":"https://openalex.org/I136259955","display_name":"Toyohashi University of Technology","ror":"https://ror.org/04ezg6d83","country_code":"JP","type":"education","lineage":["https://openalex.org/I136259955"]},{"id":"https://openalex.org/I4210167249","display_name":"Network Technologies (United States)","ror":"https://ror.org/05xnsth60","country_code":"US","type":"company","lineage":["https://openalex.org/I4210167249"]}],"countries":["JP","US"],"is_corresponding":false,"raw_author_name":"Qi Jia","raw_affiliation_strings":["Faculty of Engineering, Toyohashi University of Technology, Toyohashi, Japan 441","Qi Jia received his B.E. degree in 1985 from the Dept. Aut. Contr., Fac. Eng., Chin. Sci. Tech. Univ., China, and his Master's degree in 1989 from Toyohashi Univ. Tech., where he is presently in the doctoral program. He is engaged in research on algorithms in neural network"],"raw_orcid":null,"affiliations":[{"raw_affiliation_string":"Faculty of Engineering, Toyohashi University of Technology, Toyohashi, Japan 441","institution_ids":["https://openalex.org/I136259955"]},{"raw_affiliation_string":"Qi Jia received his B.E. degree in 1985 from the Dept. Aut. Contr., Fac. Eng., Chin. Sci. Tech. Univ., China, and his Master's degree in 1989 from Toyohashi Univ. Tech., where he is presently in the doctoral program. He is engaged in research on algorithms in neural network","institution_ids":["https://openalex.org/I4210167249"]}]},{"author_position":"middle","author":{"id":"https://openalex.org/A5108357188","display_name":"Katsuyuki Hagiwara","orcid":null},"institutions":[{"id":"https://openalex.org/I136259955","display_name":"Toyohashi University of Technology","ror":"https://ror.org/04ezg6d83","country_code":"JP","type":"education","lineage":["https://openalex.org/I136259955"]}],"countries":["JP"],"is_corresponding":false,"raw_author_name":"Katsuyuki Hagiwara","raw_affiliation_strings":["Faculty of Engineering, Toyohashi University of Technology, Toyohashi, Japan 441","Naohiro Toda received his B.E., M.S. and Dr. of Eng. degrees in 1985, 1987, and 1990, respectively, from Toyohashi Univ. Tech. He was a Research Associate in 19% at Inst. Inf. Eng., Toyohashi Univ. Tech., and Lecturer in 1992 in the Dept. Electrical Eng., Maizuru Col. Tech. He is engaged in research on nonlinear and nonstationary analysis of biological and other signals, as well as neural networks. He is a member of Soc. Instr. Contr. Eng"],"raw_orcid":null,"affiliations":[{"raw_affiliation_string":"Faculty of Engineering, Toyohashi University of Technology, Toyohashi, Japan 441","institution_ids":["https://openalex.org/I136259955"]},{"raw_affiliation_string":"Naohiro Toda received his B.E., M.S. and Dr. of Eng. degrees in 1985, 1987, and 1990, respectively, from Toyohashi Univ. Tech. He was a Research Associate in 19% at Inst. Inf. Eng., Toyohashi Univ. Tech., and Lecturer in 1992 in the Dept. Electrical Eng., Maizuru Col. Tech. He is engaged in research on nonlinear and nonstationary analysis of biological and other signals, as well as neural networks. He is a member of Soc. Instr. Contr. Eng","institution_ids":["https://openalex.org/I136259955"]}]},{"author_position":"middle","author":{"id":"https://openalex.org/A5109042215","display_name":"Shiro Usui","orcid":null},"institutions":[{"id":"https://openalex.org/I136259955","display_name":"Toyohashi University of Technology","ror":"https://ror.org/04ezg6d83","country_code":"JP","type":"education","lineage":["https://openalex.org/I136259955"]},{"id":"https://openalex.org/I2801851002","display_name":"Harvard University Press","ror":"https://ror.org/006v7bf86","country_code":"US","type":"other","lineage":["https://openalex.org/I136199984","https://openalex.org/I2801851002"]}],"countries":["JP","US"],"is_corresponding":false,"raw_author_name":"Shiro Usui","raw_affiliation_strings":["Faculty of Engineering, Toyohashi University of Technology, Toyohashi, Japan 441","Katsuyuki Hagiwara received his B.E. and M.S. degrees in 1990 and 1992, respectively, from Toyohashi Univ. where he is presently in the doctoral program. He is engaged in research on neural networks"],"raw_orcid":null,"affiliations":[{"raw_affiliation_string":"Faculty of Engineering, Toyohashi University of Technology, Toyohashi, Japan 441","institution_ids":["https://openalex.org/I136259955"]},{"raw_affiliation_string":"Katsuyuki Hagiwara received his B.E. and M.S. degrees in 1990 and 1992, respectively, from Toyohashi Univ. where he is presently in the doctoral program. He is engaged in research on neural networks","institution_ids":["https://openalex.org/I2801851002"]}]},{"author_position":"last","author":{"id":"https://openalex.org/A5047185748","display_name":"Naohiro Toda","orcid":"https://orcid.org/0000-0002-8475-5827"},"institutions":[{"id":"https://openalex.org/I16718484","display_name":"Hess (United States)","ror":"https://ror.org/00zbk1w77","country_code":"US","type":"company","lineage":["https://openalex.org/I16718484"]},{"id":"https://openalex.org/I4210090298","display_name":"National Institute of Technology, Maizuru College","ror":"https://ror.org/00b2e6559","country_code":"JP","type":"education","lineage":["https://openalex.org/I4210090298","https://openalex.org/I4210120810"]}],"countries":["JP","US"],"is_corresponding":false,"raw_author_name":"Naohiro Toda","raw_affiliation_strings":["Maizuru College of Technology, Maizuru, Japan 625","Shim Usui received his B.E. degree in 1966 from the Dept. Electrical Eng., Fac. Eng., Gifu Univ. and his Ph.D. degree (Electrical Eng. Computer Sci.) in 1964 from Univ. Calif. He was a Research Associate in 1964, Fac. Eng., Nagoya Univ., Lecturer in 1979 Toyohashi Univ. Tech., where he was Assoc. Prof., and then Prof. in 1986. He is engaged in research on biological information processing and physiological engineering. He is the author of Busk Biological Signal Processing, and other books, and a member of IEEJ; Soc. Instr. Contr. Eng.; Inf. Proc. Soc.; JSMEBE; Physiol. Soc. Jap.; Neur. Sci. Soc. Jap.; IEEE; and INNS"],"raw_orcid":null,"affiliations":[{"raw_affiliation_string":"Maizuru College of Technology, Maizuru, Japan 625","institution_ids":["https://openalex.org/I4210090298"]},{"raw_affiliation_string":"Shim Usui received his B.E. degree in 1966 from the Dept. Electrical Eng., Fac. Eng., Gifu Univ. and his Ph.D. degree (Electrical Eng. Computer Sci.) in 1964 from Univ. Calif. He was a Research Associate in 1964, Fac. Eng., Nagoya Univ., Lecturer in 1979 Toyohashi Univ. Tech., where he was Assoc. Prof., and then Prof. in 1986. He is engaged in research on biological information processing and physiological engineering. He is the author of Busk Biological Signal Processing, and other books, and a member of IEEJ; Soc. Instr. Contr. Eng.; Inf. Proc. Soc.; JSMEBE; Physiol. Soc. Jap.; Neur. Sci. Soc. Jap.; IEEE; and INNS","institution_ids":["https://openalex.org/I16718484"]}]}],"institutions":[],"countries_distinct_count":2,"institutions_distinct_count":4,"corresponding_author_ids":[],"corresponding_institution_ids":[],"apc_list":null,"apc_paid":null,"fwci":0.0,"has_fulltext":false,"cited_by_count":0,"citation_normalized_percentile":{"value":0.12436743,"is_in_top_1_percent":false,"is_in_top_10_percent":false},"cited_by_percentile_year":null,"biblio":{"volume":"26","issue":"6","first_page":"49","last_page":"58"},"is_retracted":false,"is_paratext":false,"is_xpac":false,"primary_topic":{"id":"https://openalex.org/T10205","display_name":"Advanced Fiber Optic Sensors","score":0.996999979019165,"subfield":{"id":"https://openalex.org/subfields/2208","display_name":"Electrical and Electronic Engineering"},"field":{"id":"https://openalex.org/fields/22","display_name":"Engineering"},"domain":{"id":"https://openalex.org/domains/3","display_name":"Physical Sciences"}},"topics":[{"id":"https://openalex.org/T10205","display_name":"Advanced Fiber Optic Sensors","score":0.996999979019165,"subfield":{"id":"https://openalex.org/subfields/2208","display_name":"Electrical and Electronic Engineering"},"field":{"id":"https://openalex.org/fields/22","display_name":"Engineering"},"domain":{"id":"https://openalex.org/domains/3","display_name":"Physical Sciences"}},{"id":"https://openalex.org/T10299","display_name":"Photonic and Optical Devices","score":0.996999979019165,"subfield":{"id":"https://openalex.org/subfields/2208","display_name":"Electrical and Electronic Engineering"},"field":{"id":"https://openalex.org/fields/22","display_name":"Engineering"},"domain":{"id":"https://openalex.org/domains/3","display_name":"Physical Sciences"}},{"id":"https://openalex.org/T11449","display_name":"Mechanical and Optical Resonators","score":0.9919999837875366,"subfield":{"id":"https://openalex.org/subfields/3107","display_name":"Atomic and Molecular Physics, and Optics"},"field":{"id":"https://openalex.org/fields/31","display_name":"Physics and Astronomy"},"domain":{"id":"https://openalex.org/domains/3","display_name":"Physical Sciences"}}],"keywords":[{"id":"https://openalex.org/keywords/computer-science","display_name":"Computer science","score":0.614655613899231},{"id":"https://openalex.org/keywords/information-gain","display_name":"Information gain","score":0.5579379796981812},{"id":"https://openalex.org/keywords/process","display_name":"Process (computing)","score":0.5281614661216736},{"id":"https://openalex.org/keywords/acceleration","display_name":"Acceleration","score":0.5124207139015198},{"id":"https://openalex.org/keywords/stability","display_name":"Stability (learning theory)","score":0.4902063012123108},{"id":"https://openalex.org/keywords/gradient-descent","display_name":"Gradient descent","score":0.48504799604415894},{"id":"https://openalex.org/keywords/algorithm","display_name":"Algorithm","score":0.4392218291759491},{"id":"https://openalex.org/keywords/high-gain-antenna","display_name":"High-gain antenna","score":0.42759209871292114},{"id":"https://openalex.org/keywords/artificial-intelligence","display_name":"Artificial intelligence","score":0.19230607151985168},{"id":"https://openalex.org/keywords/machine-learning","display_name":"Machine learning","score":0.1369021236896515},{"id":"https://openalex.org/keywords/physics","display_name":"Physics","score":0.10045748949050903},{"id":"https://openalex.org/keywords/artificial-neural-network","display_name":"Artificial neural network","score":0.09936559200286865}],"concepts":[{"id":"https://openalex.org/C41008148","wikidata":"https://www.wikidata.org/wiki/Q21198","display_name":"Computer science","level":0,"score":0.614655613899231},{"id":"https://openalex.org/C2983203078","wikidata":"https://www.wikidata.org/wiki/Q255166","display_name":"Information gain","level":2,"score":0.5579379796981812},{"id":"https://openalex.org/C98045186","wikidata":"https://www.wikidata.org/wiki/Q205663","display_name":"Process (computing)","level":2,"score":0.5281614661216736},{"id":"https://openalex.org/C117896860","wikidata":"https://www.wikidata.org/wiki/Q11376","display_name":"Acceleration","level":2,"score":0.5124207139015198},{"id":"https://openalex.org/C112972136","wikidata":"https://www.wikidata.org/wiki/Q7595718","display_name":"Stability (learning theory)","level":2,"score":0.4902063012123108},{"id":"https://openalex.org/C153258448","wikidata":"https://www.wikidata.org/wiki/Q1199743","display_name":"Gradient descent","level":3,"score":0.48504799604415894},{"id":"https://openalex.org/C11413529","wikidata":"https://www.wikidata.org/wiki/Q8366","display_name":"Algorithm","level":1,"score":0.4392218291759491},{"id":"https://openalex.org/C61829901","wikidata":"https://www.wikidata.org/wiki/Q769152","display_name":"High-gain antenna","level":2,"score":0.42759209871292114},{"id":"https://openalex.org/C154945302","wikidata":"https://www.wikidata.org/wiki/Q11660","display_name":"Artificial intelligence","level":1,"score":0.19230607151985168},{"id":"https://openalex.org/C119857082","wikidata":"https://www.wikidata.org/wiki/Q2539","display_name":"Machine learning","level":1,"score":0.1369021236896515},{"id":"https://openalex.org/C121332964","wikidata":"https://www.wikidata.org/wiki/Q413","display_name":"Physics","level":0,"score":0.10045748949050903},{"id":"https://openalex.org/C50644808","wikidata":"https://www.wikidata.org/wiki/Q192776","display_name":"Artificial neural network","level":2,"score":0.09936559200286865},{"id":"https://openalex.org/C111919701","wikidata":"https://www.wikidata.org/wiki/Q9135","display_name":"Operating system","level":1,"score":0.0},{"id":"https://openalex.org/C74650414","wikidata":"https://www.wikidata.org/wiki/Q11397","display_name":"Classical mechanics","level":1,"score":0.0},{"id":"https://openalex.org/C120665830","wikidata":"https://www.wikidata.org/wiki/Q14620","display_name":"Optics","level":1,"score":0.0}],"mesh":[],"locations_count":1,"locations":[{"id":"doi:10.1002/scj.4690260605","is_oa":false,"landing_page_url":"https://doi.org/10.1002/scj.4690260605","pdf_url":null,"source":{"id":"https://openalex.org/S58208175","display_name":"Systems and Computers in Japan","issn_l":"0882-1666","issn":["0882-1666","1520-684X"],"is_oa":false,"is_in_doaj":false,"is_core":true,"host_organization":"https://openalex.org/P4310320595","host_organization_name":"Wiley","host_organization_lineage":["https://openalex.org/P4310320595"],"host_organization_lineage_names":["Wiley"],"type":"journal"},"license":null,"license_id":null,"version":"publishedVersion","is_accepted":true,"is_published":true,"raw_source_name":"Systems and Computers in Japan","raw_type":"journal-article"}],"best_oa_location":null,"sustainable_development_goals":[],"awards":[],"funders":[],"has_content":{"grobid_xml":false,"pdf":false},"content_urls":null,"referenced_works_count":8,"referenced_works":["https://openalex.org/W1526055535","https://openalex.org/W1969275328","https://openalex.org/W2033245860","https://openalex.org/W2125955958","https://openalex.org/W2154744236","https://openalex.org/W2160208155","https://openalex.org/W2160778987","https://openalex.org/W2732833713"],"related_works":["https://openalex.org/W2390829436","https://openalex.org/W1989791859","https://openalex.org/W2565094479","https://openalex.org/W602859758","https://openalex.org/W2006439817","https://openalex.org/W2624382669","https://openalex.org/W1907251729","https://openalex.org/W2030419155","https://openalex.org/W2105265649","https://openalex.org/W2168355639"],"abstract_inverted_index":{"Abstract":[0],"As":[1],"the":[2,6,18,28,42,45,48,66,74,77,106,113,116,121,127,134,139,153,156,160,169,172,175,185,188,191,195,209,212,227],"method":[3,110,122,173,186,192,225],"to":[4,105,126],"accelerate":[5],"learning":[7,49,213,224],"by":[8,62],"error":[9,92,108],"back\u2010propagation,":[10],"several":[11],"studies":[12,57],"have":[13,202],"been":[14,203],"proposed":[15],"in":[16,95,220,226],"which":[17,96,201,217],"parameter":[19],"called":[20],"gain":[21,46,78,99,118,189,196,210],"is":[22,31,37,100,119,143,166,215],"introduced.":[23],"In":[24],"those":[25,56],"studies,":[26],"however,":[27],"acceleration":[29],"effect":[30,43,75,207],"evaluated":[32],"only":[33],"numerically,":[34],"and":[35,68,190],"there":[36,146],"no":[38],"theoretical":[39,164],"analysis":[40,72],"of":[41,44,73,76,155,171,184,208],"on":[47,211],"process.":[50],"This":[51,178],"paper":[52,179],"points":[53],"out":[54],"that":[55,145,151],"can":[58,102],"also":[59],"be":[60,103,124],"realized":[61],"methods":[63],"without":[64,111,137],"introducing":[65,112,138,174,187,194],"gain,":[67],"presents":[69,180],"a":[70,80,89,97,148,163,181,198,222],"detailed":[71],"from":[79,197],"unified":[81,182,199],"viewpoint.":[82],"The":[83,91,206],"following":[84],"properties":[85],"are":[86],"revealed":[87],"as":[88,131,133],"result.":[90],"back\u2010propagation":[93,109],"method,":[94,130,136],"constant":[98],"introduced,":[101,120],"reduced":[104,125],"ordinary":[107],"gain.":[114,140,157,177],"When":[115],"dynamic":[117,176],"cannot":[123],"steepest":[128],"descent":[129],"well":[132],"momentum":[135],"Furthermore,":[141],"it":[142],"shown":[144],"exists":[147],"characteristic":[149,161],"superellipse":[150],"determines":[152],"behavior":[154],"By":[158],"analyzing":[159],"superellipse,":[162],"basis":[165],"provided":[167],"for":[168],"instability":[170],"treatment":[183],"not":[193],"viewpoint":[200],"considered":[204],"independently.":[205],"process":[214],"analyzed,":[216],"will":[218],"help":[219],"developing":[221],"new":[223],"future.":[228]},"counts_by_year":[],"updated_date":"2026-06-11T09:08:48.828518","created_date":"2025-10-10T00:00:00"}