java - HtmlUnit not loading dynamic content -


i trying products loaded dynamically scrolling e-commerce website polyvore.com using htmlunit ajax requests. page source code obtained doesn't have dynamically generated products.

here htmlunit code:

try {     string url = "http://www.polyvore.com/jewelry/shop?category_id=60";     webrequest req = new webrequest(new url(url));                                    webclient webclient = new webclient(browserversion.firefox_38);     webclient.getoptions().setcssenabled(false);     webclient.getoptions().setappletenabled(false);     webclient.getoptions().setthrowexceptiononscripterror(false);     // ssl support     webclient.getoptions().setuseinsecuressl(true);     // ajax support     webclient.setajaxcontroller(new nicelyresynchronizingajaxcontroller());      webclient.waitforbackgroundjavascriptstartingbefore(600*1000);     webclient.getcurrentwindow().setinnerheight(60000);      htmlpage page = webclient.getpage(req);      string content = page.getwebresponse().getcontentasstring();     system.out.println(content); } catch (exception e) {     throw new runtimeexception(e); }

you can generate custom http requests achieve task. htmlunit supports this.

first capture traffic emulate using htmlunit.


Comments

Post a Comment

Popular posts from this blog

android - Pass an Serializable object in AIDL -

i have defined aidl file interface imyfeature { void dotask(class clazz); } but need pass class object process. possible in android? if so, how? i tried: interface imyfeature { serializable class; void dotask(class clazz); } but doesn’t work. aidl in android supports custom class implement parcelable interface. in case want send class object not possible. can send class canonical name , retrieve in service. for example have aidl file interface imyfeature { void dotask(string classname); } then call : binder.dotask(myclass.class.getcanonicalname()); and in service binder stub implementation : private final imyfeature mbinder = new imyfeature.stub() { public void dotask(string classname) { try { class<?> clazz = class.forname(classname); constructor<?> ctor = clazz.getconstructor((class[]) null); object object = ctor.newinstance(); ...
Read more

How to provide Authorization & Authentication using Asp.net, C#? -

Image
i have asp.net application in c#. i have provide page authorization specific user/usergroup. i have created 2 tables in database: 1) pagename 2)permissions[insert, update, view, delete] but i'm unable match tables , permissions assigning... can 1 please me, how created tables in database , how coding. please me. you can below explanation. configure access specific file , folder, set forms-based authentication. request page in application redirected logon.aspx automatically. in web.config file, type or paste following code. this code grants users access default1.aspx page , subdir1 folder . <configuration> <system.web> <authentication mode="forms" > <forms loginurl="login.aspx" name=".aspnetauth" protection="none" path="/" timeout="20" > </forms> </authentication> <!-- section denies access files in...
Read more

How to use Authorization & Authentication in Asp.net, C#? -

i using roll management , trying give page , folder access according user or user group, using server created ad group user authentication. i have default1.aspx page default , subdir1 folder give different access separate user group i using below logic in web.config. <location path="subdir1"> <system.web> <authorization> <allow users ="?" /> </authorization> </system.web> </location> i facing problem provide same access 2 or more directory same user should have provide allow user code twice both folder? i can use logic repeating value folder want access providing in 1 logic. i have got answer configure folder/page access, have make different access shown below.. configure access specific file , folder, set forms-based authentication. request page in application redirected logon.aspx automatically. in web.config file, done following code. this code grants user...
Read more