Forums

Selenium error

Hi,

I am trying to scrape a website using Selenium, but I get the below error when the run the code :

Code :

> from selenium.webdriver.common.by import By from
> selenium.webdriver.support.ui import WebDriverWait from
> selenium.webdriver.support import expected_conditions as EC
> 
> url =
> 'https://www.transfermarkt.com/jose-antonio-navarro/profil/spieler/462527'
> 
> chrome_options = webdriver.ChromeOptions()
> chrome_options.add_argument("--no-sandbox")
> chrome_options.add_argument("--headless")
> chrome_options.add_argument("--disable-gpu")
> chrome_options.add_argument('--disable-dev-shm-usage')
> 
> driver = webdriver.Chrome(options=chrome_options) driver.get(url)
> 
> page_source = driver.page_source driver.quit()
> 
> soup = BeautifulSoup(page_source, "lxml")

Error :

WebDriverException: Message: unknown error: Chrome failed to start: exited abnormally. (unknown error: DevToolsActivePort file doesn't exist) (The process started from chrome location /usr/bin/chromium is no longer running, so ChromeDriver is assuming that Chrome has crashed.)

What happens if you try without this line:

chrome_options.add_argument('--disable-dev-shm-usage')

...?