delorie.com/archives/browse.cgi   search  
Mail Archives: cygwin/2021/09/23/13:34:14

X-Recipient: archive-cygwin AT delorie DOT com
X-Original-To: cygwin AT cygwin DOT com
Delivered-To: cygwin AT cygwin DOT com
DMARC-Filter: OpenDMARC Filter v1.4.1 sourceware.org 2A5AF3857C48
Authentication-Results: sourceware.org;
dmarc=none (p=none dis=none) header.from=bellsouth.net
Authentication-Results: sourceware.org; spf=none smtp.mailfrom=bellsouth.net
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bellsouth.net; s=s2048;
t=1632418371; bh=HoHBmaz5ih+MuWHZDNCEBKQTajhmK5ORBY/Elkq+E1I=;
h=From:To:Subject:Date:References:From:Subject:Reply-To;
b=LqGxPs79ryqf7HRvpWem3lxvXZ9zuJcCd/GG7rSapyldmg9Rqm5DCWxMoxynG+uT74Stcwd1a9WPasWNW0KYZAUKIYcCr6lLDYZMRZLUf4hKyOpzkiyNLkLKE+bqLcPctBDQowaGFRXBDbqwleI6mPiKodzPMTvBFurMnosHCN3Tq49yLbkdAl9AXP7g5P+J74VTaqv95U3W3NtuBfWXi42TiySqGP8joSr5sXqm3XMfmAZo2pAcZMWDCx40Etuh1Gh08m1jeD5mk8jXEfiu+3FoJUz0fRwKH0JMuelG4RtiuTc7cQC96kD1n9okSFIZVNaNjupg7RSSWKe8FP5gFg==
X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048;
t=1632418371; bh=bVBsYxbp2gYHSlkDJLPEw/jtFWg7AASnCVAGQKCD03W=;
h=X-Sonic-MF:From:To:Subject:Date:From:Subject;
b=kbdveXyjPIS3Uk+YAzt8fXr0cLREm5L/zrADhIGnTXRSHHHUODMH+TPi+bhzastLp/r/6Q+aMeaupEqzGG2dVta4edoI9rwFx0BKRPsde6g8On/CoF6sLP44NWsNDEKIZSxCt6vlsfR+VIXWtFnj7r1jqk6TW3mhm43ktM1a7WS0aaL/l8bvTHpKXh8Z1uolqQHy27nfbeh3E9FCFq8AY6kdwYnzVwvzjcJoQVemOKmiGSdrq551qcWnUGtLDiGq4r/W87UbDfyI+/AObIzLuvph4KpRyJBjgRWYfR4Y15vNciaPvU2lO0CuBAw8swu84jPyGIWuHedy0xCWo+1BSw==
X-YMail-OSG: vNQ.XdYVM1ndf0nxXLWTAin.HQQFAvTTIiDtqZ8k2.Lx4T_6Of1HE13I9QAclNm
CuiX2xIccmJkWbsOfKhydsmv0kqNYghNN7hqhCDo2AsLfpw7q2g8c2CmsW_Az5PhQUx28UxHSj2M
obor2cU.29JUx_EviTtux0B3W6jhO0X5ZS.7foFfsXtK41CLtp55eA8tEgJjfzgLYF6UWOgFty5R
awIVaMhMzP.pU4ol5.qTTglkNw.xNz6KjpZ4TH7eu8HleM8zj2MGD8qzhOWwkCaAxHqVXsnLizAO
HxyZG.Mt2V4BSBptS6l6P1FCWLZmXjWtXrw_viZAwwRPfqSiSsuzF9GYlbfAT2XfoGU_qbzjV46W
_7KwJ8D5Zl.qnm4zKlxCReoGge5Zlz7dx9Jo40_zAerJkWo7bHba5Uf2q0fWUbx47QKEpdhC1lUC
7JK8_3KvwklN.9muflYwdH14mDyaxtujJerCl5fXn3l2YEOPHyMPL57rGC0JDrG5C2OLzzgMZaOn
h5_2o6Y_378yWlL6yL3tuzPfaztN7eug6Ks2x2eSzgjppuIeLxTodbHSHElZ7qZ6dtb9WyZOigcM
5BbDyyNKIVNJ7LlD1HDrruWDX7PGswWRNs7aEamNtXEx7.HjztgSPUq.L2qFXI0sLUxnddGJK7br
iAsixU_dqjKOO8ZApXEAv1tKLLmAKn17tOBv3yJuadxvP.KByBu4.YlXZveXLmp80IuEw.3yrNJJ
O25qOtT27fUNjjz.ajz.DAxC0Ck1qnO7ZGIVHefrl.fS6c.n22x8lHU_5zQhdjCFoB2H683yM8jW
ExaCJoAwTNMScdJhQ0L7l2HVox6exUOjE.AKEoJFYeHOWmlYlkIomSRxbn8HLDoTl9bbtPeTkIcb
VyzJ7WevNWxpmf3DFBD2pv0Yvl4Nm6MgAv1NCrbxN5iFTQfBqLoh7pMJ27grrnVOP8MJCAI7sQ6t
s9XRxPHeilqdtkLzzpSvboxtVLjsNt3mADOd31NW0JbQ5dcrGGg7xQ2kJuwvXMiDvxrGWKZKEbW.
89iY.5ncsJ2Bb5y8J4wcNPjSEidoV9vi5yxJZgwosZMbkkXCh_Xys1MIfX1ZBJeDg5DNaAr10n99
8F0fAWatXL0vyJ7QSzHHLuBF1oJxDHKrzDkQX00eUBvldGeoYiqOP5R93cYuMAAQF7A61nMAw9AG
9YDVvbs1TKJWMgGzPasLs_cKZW3zgkepPpdYR7QnDYTBdPiwRJpKefAhkJ5RTMq5GWlbfgq_j9bX
YkOUCQmIDN3p7CctD2L3O3dq8vccsCy7ZRk7liYpmGPMEGDJTfl6p3nBEPrwH0RXyIhmg1F7mWMT
ROCnFZIOngrRpq.jJ3R9hTgtFHITD8Yu.pl_Ec26xbELFwVU1kZk1BNsUm_8YEgZGxmS4mWNlxIV
RDJMdTW3h05LkwasosFa5IASflpnkaeRSHuVXgnCaOZNOQoMvfscxNXEMMX.J1dzgcuEPXRfo3F2
cL5ioopAIWkT.A.KNurtQrHdvti5FO3be58PGulmSnwbqmf9q_2SYw2rqpv4v.ECgnuT5Y1x_YjI
an58Z4NTEbEGbpvOTvr0yO6bROqfeNgIYfcPVpLAolk.RFAbc46NmlwvKVLNxQ9nHFa.YWlIPfr2
mZ.E.WMzRe6kxGeauNZwGGQB0SDj8EIy.yK5bOTER_vdUMSZoz7mS_1SPyxm96Q9_fDBJ4lTXUry
gScf3MbnrXLyMw6ORU7obdnW3f77ZKndSjCJ4Z4BIhcWHoS261ipO40CeFc8pIBgN6O1ptbYdaqo
QZ5TwDRNFKeVfwJ3Q_QPVkwO8So2ckrcc_BtXYfMke30EmuhbV0AUYVL6x2J712XNU.0VaUpDt9T
.xCPT2GyZaW.p1GE7JjaNAYzCKc7QRTn9j0t6if1fZ1n8Wig9d4_SLJKb_mAp5LErnR.R0skr8hu
_m9FpU88YgnSFp7l6wtDt4.02MM7alW.xAE0v9LNuiFkg2xCIdc8hq19vYT_Zb6Keuf5ayEUQa9n
9aR52uqrmoX5.gG87mtKl.XCVAZce18D18visLfvu3hfuD8V76XL24seLukNVyIPXW_DckmmRZeK
TAZ2hLpKdc_zBoiUpHGRcprkmDFTXLiRFIt_hj7YIsTdGJY1ZtjZ0j1DnA5JXiEA4dPIfqbdERPT
yNiSRg1tre6i.WlsaBsWx6O8LMscNG2GpEAhp_Jh31Ek0IyRiqGuyDI0Awl5xyDxd.O1LnU7UFpl
0mK0k4OoMOinTV..AYXqjdE51.AjKskal9aW3wWVm8sWGIym6j.nOM83EseflFJJCc2V9Z7_1JBG
F7u9KC9WA_VLMOx0v3xE-
X-Sonic-MF: <dap1 AT bellsouth DOT net>
From: Dennis Putnam <dap1 AT bellsouth DOT net>
To: cygwin <cygwin AT cygwin DOT com>
Subject: pyppeteer error in Python3
Message-ID: <d341cef6-cd51-67ec-0fec-7efdf19d4b13@bellsouth.net>
Date: Thu, 23 Sep 2021 13:32:48 -0400
User-Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:78.0) Gecko/20100101
Thunderbird/78.14.0
MIME-Version: 1.0
References: <d341cef6-cd51-67ec-0fec-7efdf19d4b13 DOT ref AT bellsouth DOT net>
X-Mailer: WebService/1.1.19043
mail.backend.jedi.jws.acl:role.jedi.acl.token.atz.jws.hermes.yahoo
X-Spam-Status: No, score=4.2 required=5.0 tests=BAYES_00, DKIM_SIGNED,
DKIM_VALID, DKIM_VALID_AU, DKIM_VALID_EF, FREEMAIL_ENVFROM_END_DIGIT,
FREEMAIL_FROM, HTML_MESSAGE, KAM_NUMSUBJECT, RCVD_IN_DNSWL_NONE,
RCVD_IN_MSPIKE_H2, SPAM_BODY, SPF_HELO_NONE, SPF_NONE,
TXREP autolearn=no autolearn_force=no version=3.4.4
X-Spam-Level: ****
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on
server2.sourceware.org
X-Content-Filtered-By: Mailman/MimeDel 2.1.29
X-BeenThere: cygwin AT cygwin DOT com
X-Mailman-Version: 2.1.29
List-Id: General Cygwin discussions and problem reports <cygwin.cygwin.com>
List-Archive: <https://cygwin.com/pipermail/cygwin/>
List-Post: <mailto:cygwin AT cygwin DOT com>
List-Help: <mailto:cygwin-request AT cygwin DOT com?subject=help>
List-Subscribe: <https://cygwin.com/mailman/listinfo/cygwin>,
<mailto:cygwin-request AT cygwin DOT com?subject=subscribe>
Sender: "Cygwin" <cygwin-bounces+archive-cygwin=delorie DOT com AT cygwin DOT com>
X-MIME-Autoconverted: from base64 to 8bit by delorie.com id 18NHYDZD028510

*I'm not sure this is really a cygwin problem but I don't know where 
else to ask. I'm runing a python3 script to extract a web page:**
*
#!/usr/bin/python3

# This script auto submitsw do not call complaints

from bs4 import BeautifulSoup
from requests_html import HTMLSession
from urllib.parse import urljoin

print('Starting process')
session=HTMLSession()

def get_all_forms(url):
    """Returns all form tags found on a web page's `url` """
    # GET request
    print("getting page")
    res = session.get(url)
    # for javascript driven website
    print("Running Javascript")
    res.html.render()
    print("parsing url")
    soup = BeautifulSoup(res.html.html, "html.parser")
    return soup.find_all("form")
print(get_all_forms("https://blahblah"))

*The result is a traceback when executing 'res.html.render'.*

Traceback (most recent call last):
   File "./donotcall.py", line 23, in <module>
print(get_all_forms("https://www.donotcall.gov/report.html#step1"))
   File "./donotcall.py", line 19, in get_all_forms
     res.html.render()
   File "/usr/local/lib/python3.8/site-packages/requests_html.py", line 
586, in render
     self.browser = self.session.browser  # Automatically create a event 
loop and browser
   File "/usr/local/lib/python3.8/site-packages/requests_html.py", line 
730, in browser
     self._browser = self.loop.run_until_complete(super().browser)
   File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in 
run_until_complete
     return future.result()
   File "/usr/local/lib/python3.8/site-packages/requests_html.py", line 
714, in browser
     self._browser = await 
pyppeteer.launch(ignoreHTTPSErrors=not(self.verify), headless=True, 
args=self.__browser_args)
   File "/usr/local/lib/python3.8/site-packages/pyppeteer/launcher.py", 
line 307, in launch
     return await Launcher(options, **kwargs).launch()
   File "/usr/local/lib/python3.8/site-packages/pyppeteer/launcher.py", 
line 168, in launch
     self.browserWSEndpoint = get_ws_endpoint(self.url)
   File "/usr/local/lib/python3.8/site-packages/pyppeteer/launcher.py", 
line 227, in get_ws_endpoint
     raise BrowserError('Browser closed unexpectedly:\n')
pyppeteer.errors.BrowserError: Browser closed unexpectedly:

*From what I can find with my searches, it has something to do with 
pyppeteer (chromium)  and synchronization. Can someone help me debug 
this or point me to a better place to ask? TIA.*



-- 
Problem reports:      https://cygwin.com/problems.html
FAQ:                  https://cygwin.com/faq/
Documentation:        https://cygwin.com/docs.html
Unsubscribe info:     https://cygwin.com/ml/#unsubscribe-simple

- Raw text -


  webmaster     delorie software   privacy  
  Copyright © 2019   by DJ Delorie     Updated Jul 2019