{"id":3850,"date":"2023-01-24T11:46:57","date_gmt":"2023-01-24T09:46:57","guid":{"rendered":"https:\/\/gaz-temporal.i3a.es\/?p=3850"},"modified":"2023-01-24T11:46:59","modified_gmt":"2023-01-24T09:46:59","slug":"sparse-accelerator","status":"publish","type":"post","link":"https:\/\/gaz.i3a.es\/es\/sparse-accelerator\/","title":{"rendered":"<strong>SPARSE ACCELERATOR<\/strong>"},"content":{"rendered":"<div id=\"pl-gb3850-6a139253eeaca\"  class=\"panel-layout\" ><div id=\"pg-gb3850-6a139253eeaca-0\"  class=\"panel-grid panel-has-style\" ><div class=\"siteorigin-panels-stretch panel-row-style panel-row-style-for-gb3850-6a139253eeaca-0\" data-stretch-type=\"full-width-stretch\" ><div id=\"pgc-gb3850-6a139253eeaca-0-0\"  class=\"panel-grid-cell\" ><div id=\"panel-gb3850-6a139253eeaca-0-0-0\" class=\"so-panel widget widget_sow-hero panel-first-child panel-last-child\" data-index=\"0\" ><div\n\t\t\t\n\t\t\tclass=\"so-widget-sow-hero so-widget-sow-hero-default-93415d0e2dbf-3850 so-widget-fittext-wrapper\"\n\t\t\t data-fit-text-compressor=\"0.85\"\n\t\t>\t\t\t\t<div class=\"sow-slider-base\" style=\"display: none\" tabindex=\"0\">\n\t\t\t\t\t<ul\n\t\t\t\t\tclass=\"sow-slider-images\"\n\t\t\t\t\tdata-settings=\"{&quot;pagination&quot;:true,&quot;speed&quot;:800,&quot;timeout&quot;:8000,&quot;paused&quot;:false,&quot;pause_on_hover&quot;:false,&quot;swipe&quot;:true,&quot;nav_always_show_desktop&quot;:&quot;&quot;,&quot;nav_always_show_mobile&quot;:&quot;&quot;,&quot;breakpoint&quot;:&quot;780px&quot;,&quot;unmute&quot;:false,&quot;anchor&quot;:null}\"\n\t\t\t\t\t\t\t\t\t\tdata-anchor-id=\"\"\n\t\t\t\t>\t\t<li class=\"sow-slider-image\" style=\"visibility: visible;;background-color: #1e73be\" >\n\t\t\t\t\t<div class=\"sow-slider-image-container\">\n\t\t\t<div class=\"sow-slider-image-wrapper\">\n\t\t\t\t<h3 style=\"text-align: center\"><a href=\"..\/repositories\/\">Repositorios<\/a><\/h3>\n<h1 class=\"ultp-block-title\" style=\"text-align: center\">SPARSE ACCELERATOR<\/h1>\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t<\/li>\n\t\t<\/ul>\t\t\t\t<ol class=\"sow-slider-pagination\">\n\t\t\t\t\t\t\t\t\t\t\t<li><a href=\"#\" data-goto=\"0\" aria-label=\"mostrar diapositiva 1\"><\/a><\/li>\n\t\t\t\t\t\t\t\t\t<\/ol>\n\n\t\t\t\t<div class=\"sow-slide-nav sow-slide-nav-next\">\n\t\t\t\t\t<a href=\"#\" data-goto=\"next\" aria-label=\"diapositiva siguiente\" data-action=\"next\">\n\t\t\t\t\t\t<em class=\"sow-sld-icon-thin-right\"><\/em>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\n\t\t\t\t<div class=\"sow-slide-nav sow-slide-nav-prev\">\n\t\t\t\t\t<a href=\"#\" data-goto=\"previous\" aria-label=\"diapositiva anterior\" data-action=\"prev\">\n\t\t\t\t\t\t<em class=\"sow-sld-icon-thin-left\"><\/em>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div><\/div><\/div><\/div><\/div><\/div><\/div>\n\n<div id=\"pl-gb3850-6a139253ef5ba\"  class=\"panel-layout\" ><div id=\"pg-gb3850-6a139253ef5ba-0\"  class=\"panel-grid panel-no-style\" ><div id=\"pgc-gb3850-6a139253ef5ba-0-0\"  class=\"panel-grid-cell\" ><div id=\"panel-gb3850-6a139253ef5ba-0-0-0\" class=\"so-panel widget widget_sow-cta panel-first-child panel-last-child\" data-index=\"0\" ><div\n\t\t\t\n\t\t\tclass=\"so-widget-sow-cta so-widget-sow-cta-default-54eb91ca71d3-3850\"\n\t\t\t\n\t\t><div\n\tclass=\"sow-cta-base\"\n\t>\n\t\n\t<div class=\"sow-cta-wrapper\">\n\n\t\t<div class=\"sow-cta-text\">\n\t\t\t\t\t\t\t<h4 class=\"sow-cta-title\">\n\t\t\t\t\tGo to repository\t\t\t\t<\/h4>\n\t\t\t\n\t\t\t\t\t<\/div>\n\n\t\t<div\n\t\t\t\n\t\t\tclass=\"so-widget-sow-button so-widget-sow-button-flat-4c3e8fecb75d\"\n\t\t\t\n\t\t><div class=\"ow-button-base ow-button-align-center\"\n>\n\t\t\t<a\n\t\t\t\t\thref=\"https:\/\/github.com\/universidad-zaragoza\/pipelined_architecture_for_sparse_DNNs\"\n\t\t\t\t\tclass=\"sowb-button ow-icon-placement-right ow-button-hover\" target=\"_blank\" rel=\"noopener noreferrer\" \t>\n\t\t<span>\n\t\t\t\t\t\t\t<div class=\"sow-icon-image\" style=\"background-image: url(https:\/\/gaz.i3a.es\/wp-content\/uploads\/2023\/01\/github_icon.png)\"><\/div>\n\t\t\t\t\n\t\t\tGo\t\t<\/span>\n\t\t\t<\/a>\n\t<\/div>\n<\/div>\n\t<\/div>\n\n\t<\/div>\n<\/div><\/div><\/div><div id=\"pgc-gb3850-6a139253ef5ba-0-1\"  class=\"panel-grid-cell\" ><div id=\"panel-gb3850-6a139253ef5ba-0-1-0\" class=\"so-panel widget widget_sow-editor panel-first-child panel-last-child\" data-index=\"1\" ><div\n\t\t\t\n\t\t\tclass=\"so-widget-sow-editor so-widget-sow-editor-base\"\n\t\t\t\n\t\t>\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t<section class=\"kc-elm kc-css-46569 kc_row\">\n<div class=\"kc-row-container kc-container\">\n<div class=\"kc-wrap-columns\">\n<div class=\"kc-elm kc-css-389721 kc_col-sm-10 kc_column kc_col-sm-10\">\n<div class=\"kc-col-container\">\n<div class=\"kc-elm kc-css-704317 kc_text_block\">\n<section class=\"kc-elm kc-css-825285 kc_row\">\n<div class=\"kc-row-container kc-container\">\n<div class=\"kc-wrap-columns\">\n<div class=\"kc-elm kc-css-970762 kc_col-sm-10 kc_column kc_col-sm-10\">\n<div class=\"kc-col-container\">\n<div class=\"kc-elm kc-css-601193 kc_text_block\">\n<p>This repository contains the VHDL code of the accelerator described in the paper \u201cAnalysis of a Pipelined Architecture for Sparse DNNs on Embedded Systems&#8221;, available on\u00a0<a href=\"https:\/\/doi.org\/10.1109\/TVLSI.2020.3005451\">https:\/\/doi.org\/10.1109\/TVLSI.2020.3005451<\/a>.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/section>\n<section class=\"kc-elm kc-css-719385 kc_row\">\n<div class=\"kc-row-container kc-container\">\n<div class=\"kc-wrap-columns\">\n<div class=\"kc-elm kc-css-600712 kc_col-sm-12 kc_column kc_col-sm-12\">\n<div class=\"kc-col-container\"><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div>\n<\/div><\/div><\/div><\/div><div id=\"pg-gb3850-6a139253ef5ba-1\"  class=\"panel-grid panel-no-style\" ><div id=\"pgc-gb3850-6a139253ef5ba-1-0\"  class=\"panel-grid-cell\" ><div id=\"panel-gb3850-6a139253ef5ba-1-0-0\" class=\"so-panel widget widget_sow-editor panel-first-child panel-last-child\" data-index=\"2\" ><div\n\t\t\t\n\t\t\tclass=\"so-widget-sow-editor so-widget-sow-editor-base\"\n\t\t\t\n\t\t>\n<div class=\"siteorigin-widget-tinymce textwidget\">\n\t<p><strong>Analysis of a pipelined architecture for sparse DNNs on embedded systems<\/strong><\/p>\n<p>Deep neural networks (DNNs) are increasing their presence in a wide range of applications, and their computationally intensive and memory-demanding nature poses challenges, especially for embedded systems. Pruning techniques turn DNN models into sparse by setting most weights to zero, offering optimization opportunities if specific support is included. We propose a novel pipelined architecture for DNNs that avoids all useless operations during the inference process. It has been implemented in a field-programmable gate array (FPGA), and the performance, energy efficiency, and area have been characterized. Exploiting sparsity yields remarkable speedups but also produces area overheads. We have evaluated this tradeoff in order to identify in which scenarios it is better to use that area to exploit sparsity, or to include more computational resources in a conventional DNN architecture.<\/p>\n<p>We have also explored different arithmetic bitwidths. Our sparse architecture is clearly superior on 32-bit arithmetic or highly sparse networks. However, on 8-bit arithmetic or networks with low sparsity it is more profitable to deploy a dense architecture with more arithmetic resources than including support for sparsity. We consider that FPGAs are the natural target for DNN sparse accelerators since they can be loaded at run-time with the best-fitting accelerator.<\/p>\n<\/div>\n<\/div><\/div><\/div><\/div><\/div>\n\n\n<p><\/p>","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":3636,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[241],"tags":[],"class_list":["post-3850","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-repositories"],"_links":{"self":[{"href":"https:\/\/gaz.i3a.es\/es\/wp-json\/wp\/v2\/posts\/3850","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/gaz.i3a.es\/es\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/gaz.i3a.es\/es\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/gaz.i3a.es\/es\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/gaz.i3a.es\/es\/wp-json\/wp\/v2\/comments?post=3850"}],"version-history":[{"count":1,"href":"https:\/\/gaz.i3a.es\/es\/wp-json\/wp\/v2\/posts\/3850\/revisions"}],"predecessor-version":[{"id":3851,"href":"https:\/\/gaz.i3a.es\/es\/wp-json\/wp\/v2\/posts\/3850\/revisions\/3851"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/gaz.i3a.es\/es\/wp-json\/wp\/v2\/media\/3636"}],"wp:attachment":[{"href":"https:\/\/gaz.i3a.es\/es\/wp-json\/wp\/v2\/media?parent=3850"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/gaz.i3a.es\/es\/wp-json\/wp\/v2\/categories?post=3850"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/gaz.i3a.es\/es\/wp-json\/wp\/v2\/tags?post=3850"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}