Rselenium error - Selenium message:Java heap space

Asked

Viewed 170 times

2

Hello, I’m trying to make a scraping of http://acervo.estadao.com.br/ using Rselenium, because the page only generates the information in html when it is loaded in the browser.

Well, when it happens, I can’t do it any other way than with Rselenium. But when the loop runs about 250 times, it closes and appears the message below:

Selenium message:Java heap space

Error: Summary: Unknownerror Detail: An Unknown server-side error occurred while Processing the command. Further Details: run errorDetails method

section information

R version 3.4.0 (2017-04-21) Platform: x86_64-apple-darwin15.6.0 (64-bit) Running under: macOS Sierra 10.12.6

Matrix products: default BLAS: /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib LAPACK: /Library/Frameworks/R.framework/Versions/3.4/Resources/lib/libRlapack.dylib

locale: [1] pt_BR.UTF-8/pt_BR.UTF-8/pt_BR.UTF-8/C/pt_BR.UTF-8/pt_BR.UTF-8

Attached base Packages: [1] Stats Graphics grDevices utils
datasets methods base

other Attached Packages: [1] wdman_0.2.2 magrittr_1.5
rvest_0.3.2 xml2_1.1.1 [5] httr_1.3.1 XML_3.98-1.9
Rselenium_1.7.1

r selenium-webdriver web-scraping

1 answer

2

Problems related to heap are connected to memory, in this case the memory that java has allocated, when trying to find the command to compile with more memory, or if this is not compiled try to find a way for your program to use more memory than is already provided.

Browser other questions tagged r selenium-webdriver web-scraping

You are not signed in. Login or sign up in order to post.