python - Python3.4 : Multiprocessing variable functions -


i running code below using multiprocessing run ticker_list through request , parsing program faster. following code works, slow. not sure correct usage of multiprocessing. if there more efficient way please let me know.

ticker_list = []  open('/home/a73nk-xce/documents/python/sharkfin/sp500_fin/sp_stockchar/ticker.csv', 'r', newline='') csvfile:     spamreader = csv.reader(csvfile)     rows in spamreader:         pass      eachticker in rows:         ticker_list.append(eachticker)  def final_function(ticker):     try:         getfindata.cashdata(ticker_list)       except exception e:         pass  if __name__ == '__main__':     jobs = []     p = mp.process(target=final_function, args=(ticker_list,))     jobs.append(p)     p.start()     p.join()

if ticker file large (judging path name, may be)

using csv reader waste of time. not suport seek, way can last line 

    row in spamreader:         pass

since after "row" contain last row in file..

you can see here: most efficient way search last x lines of file in python it's possible retrieve last lines in file, , parse csv module afterward..

this save computation time..


Comments

Post a Comment

Popular posts from this blog

How to provide Authorization & Authentication using Asp.net, C#? -

Image
i have asp.net application in c#. i have provide page authorization specific user/usergroup. i have created 2 tables in database: 1) pagename 2)permissions[insert, update, view, delete] but i'm unable match tables , permissions assigning... can 1 please me, how created tables in database , how coding. please me. you can below explanation. configure access specific file , folder, set forms-based authentication. request page in application redirected logon.aspx automatically. in web.config file, type or paste following code. this code grants users access default1.aspx page , subdir1 folder . <configuration> <system.web> <authentication mode="forms" > <forms loginurl="login.aspx" name=".aspnetauth" protection="none" path="/" timeout="20" > </forms> </authentication> <!-- section denies access files in...
Read more

toolbar - How to add link to user registration inside toobar in admin joomla 3 custom component -

im trying write component admin side , need add user creation. dont want duplicate existing codes add link. know how add task not simple link toolbar. thx help. if wanting button opens new user screen can try in component: $bar = jtoolbar::getinstance('toolbar'); $bar->appendbutton('link', 'users', 'new user','index.php?option=com_users&task=user.add'); you need add view.html.php file wherever you're creating toolbar. is need?
Read more

How to use Authorization & Authentication in Asp.net, C#? -

i using roll management , trying give page , folder access according user or user group, using server created ad group user authentication. i have default1.aspx page default , subdir1 folder give different access separate user group i using below logic in web.config. <location path="subdir1"> <system.web> <authorization> <allow users ="?" /> </authorization> </system.web> </location> i facing problem provide same access 2 or more directory same user should have provide allow user code twice both folder? i can use logic repeating value folder want access providing in 1 logic. i have got answer configure folder/page access, have make different access shown below.. configure access specific file , folder, set forms-based authentication. request page in application redirected logon.aspx automatically. in web.config file, done following code. this code grants user...
Read more