Design, Implementation and Performance Evaluation of a Stochastic Gradient Descent Algorithm on CUDA

Emanuele De Falco
Sapienza University of Rome
Sapienza University of Rome, Technical Report n. 11, 2015

   title={Design, Implementation and Performance Evaluation of a Stochastic Gradient Descent Algorithm on CUDA},

   author={De Falco, Emanuele and others},


   institution={Department of Computer, Control and Management Engineering, Universita’degli Studi di Roma" La Sapienza"}


Download Download (PDF)   View View   Source Source   



Stochastic Gradient Descent, a stochastic optimization of Gradient Descent, is an algorithm that is used in different topics, like for example for linear regression or logistic regression. After the Netflix prize, SGD start to be used also in recommender systems to compute matrix factorization. Considering the large amounts of data that this kind of system has to elaborate, adapt the algorithm on a distributed system or parallelize it is a good idea to improve performance. One way to do this is by using GPGPU, that thanks to its characteristics it’s now days a good solution for parallelize an application. With this work, we are interested in analyze how SGD works on a GPGPU environment that is designed with a CUDA architecture, starting from an existing implementation for parallel environments and then adapting it to exploits all characteristics that a GPU of this kind provide.
VN:F [1.9.22_1171]
Rating: 0.0/5 (0 votes cast)

* * *

* * *

TwitterAPIExchange Object
    [oauth_access_token:TwitterAPIExchange:private] => 301967669-yDz6MrfyJFFsH1DVvrw5Xb9phx2d0DSOFuLehBGh
    [oauth_access_token_secret:TwitterAPIExchange:private] => o29ji3VLVmB6jASMqY8G7QZDCrdFmoTvCDNNUlb7s
    [consumer_key:TwitterAPIExchange:private] => TdQb63pho0ak9VevwMWpEgXAE
    [consumer_secret:TwitterAPIExchange:private] => Uq4rWz7nUnH1y6ab6uQ9xMk0KLcDrmckneEMdlq6G5E0jlQCFx
    [postfields:TwitterAPIExchange:private] => 
    [getfield:TwitterAPIExchange:private] => ?cursor=-1&screen_name=hgpu&skip_status=true&include_user_entities=false
    [oauth:protected] => Array
            [oauth_consumer_key] => TdQb63pho0ak9VevwMWpEgXAE
            [oauth_nonce] => 1477142619
            [oauth_signature_method] => HMAC-SHA1
            [oauth_token] => 301967669-yDz6MrfyJFFsH1DVvrw5Xb9phx2d0DSOFuLehBGh
            [oauth_timestamp] => 1477142619
            [oauth_version] => 1.0
            [cursor] => -1
            [screen_name] => hgpu
            [skip_status] => true
            [include_user_entities] => false
            [oauth_signature] => CMxpdbE41EYZOCI2cp5zB0rstDI=

    [url] => https://api.twitter.com/1.1/users/show.json
Follow us on Facebook
Follow us on Twitter

HGPU group

2033 peoples are following HGPU @twitter

HGPU group © 2010-2016 hgpu.org

All rights belong to the respective authors

Contact us: