debugging dask - failed to detect client -


my dask groupby script failing (memory error) set off debug script. i'm running on stand-alone computer .
i've updated logging in config.yaml file with
logging: distributed: debug bokeh: debug tornado: info

i'm running dask distributed example computation following updates:

from distributed import localcluster   c=localcluster()   

and updated script range amended range(10000) .

while script runs (and completes) see following logs in jupyter notebook repeats until script completes.

bokeh.server.tornado - debug - [pid 3088] 0 clients connected
bokeh.server.tornado - debug - [pid 3088] /system has 0 sessions 0 unused bokeh.server.tornado - debug - [pid 3088] /stealing has 0 sessions 0 unused bokeh.server.tornado - debug - [pid 3088] /workers has 0 sessions 0 unused bokeh.server.tornado - debug - [pid 3088] /events has 0 sessions 0 unused bokeh.server.tornado - debug - [pid 3088] /counters has 0 sessions 0 unused bokeh.server.tornado - debug - [pid 3088] /tasks has 0 sessions 0 unused bokeh.server.tornado - debug - [pid 3088] /status has 0 sessions 0 unused

why don't see workers running?

i following log when running c = localcluster()

bokeh.server.server - info - starting bokeh server version 0.12.4
bokeh.server.server - warning - host wildcard '' can expose application http host header attacks. host wildcard should used testing purpose. bokeh.server.server - warning - host wildcard '' can expose application http host header attacks. host wildcard should used testing purpose. bokeh.server.tornado - debug - allowed host headers: [''] bokeh.server.tornado - debug - these host origins can connect websocket: [''] bokeh.server.tornado - debug - patterns are: bokeh.server.tornado - debug - [('/system/?', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/system/ws'}), bokeh.server.tornado - debug - ('/system/ws', bokeh.server.tornado - debug - , bokeh.server.tornado - debug -
{'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/system/ws'}), bokeh.server.tornado - debug - ('/system/autoload.js', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/system/ws'}), bokeh.server.tornado - debug - ('/stealing/?', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/stealing/ws'}), bokeh.server.tornado - debug - ('/stealing/ws', bokeh.server.tornado - debug - , bokeh.server.tornado - debug -
{'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/stealing/ws'}), bokeh.server.tornado - debug - ('/stealing/autoload.js', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/stealing/ws'}), bokeh.server.tornado - debug - ('/workers/?', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/workers/ws'}), bokeh.server.tornado - debug - ('/workers/ws', bokeh.server.tornado - debug - , bokeh.server.tornado - debug -
{'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/workers/ws'}), bokeh.server.tornado - debug - ('/workers/autoload.js', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/workers/ws'}), bokeh.server.tornado - debug - ('/events/?', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/events/ws'}), bokeh.server.tornado - debug - ('/events/ws', bokeh.server.tornado - debug - , bokeh.server.tornado - debug -
{'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/events/ws'}), bokeh.server.tornado - debug - ('/events/autoload.js', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/events/ws'}), bokeh.server.tornado - debug - ('/counters/?', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/counters/ws'}), bokeh.server.tornado - debug - ('/counters/ws', bokeh.server.tornado - debug - , bokeh.server.tornado - debug -
{'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/counters/ws'}), bokeh.server.tornado - debug - ('/counters/autoload.js', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/counters/ws'}), bokeh.server.tornado - debug - ('/tasks/?', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/tasks/ws'}), bokeh.server.tornado - debug - ('/tasks/ws', bokeh.server.tornado - debug - , bokeh.server.tornado - debug -
{'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/tasks/ws'}), bokeh.server.tornado - debug - ('/tasks/autoload.js', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/tasks/ws'}), bokeh.server.tornado - debug - ('/status/?', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/status/ws'}), bokeh.server.tornado - debug - ('/status/ws', bokeh.server.tornado - debug - , bokeh.server.tornado - debug -
{'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/status/ws'}), bokeh.server.tornado - debug - ('/status/autoload.js', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'application_context': , bokeh.server.tornado - debug -
'bokeh_websocket_path': '/status/ws'}), bokeh.server.tornado - debug - ('/?', bokeh.server.tornado - debug - , bokeh.server.tornado - debug - {'applications': {'/counters': , bokeh.server.tornado - debug -
'/events': , bokeh.server.tornado - debug -
'/status': , bokeh.server.tornado - debug -
'/stealing': , bokeh.server.tornado - debug -
'/system': , bokeh.server.tornado - debug -
'/tasks': , bokeh.server.tornado - debug -
'/workers': }, bokeh.server.tornado - debug -
'prefix': '', bokeh.server.tornado - debug - 'use_redirect': true}), bokeh.server.tornado - debug - ('/static/(.*)', bokeh.server.tornado - debug - )]

the logging messages you're seeing bokeh diagnostic dashboard. they're saying no 1 looking @ diagnostic webpage. might want decrease verbosity of bokeh logging. don't think these messages concern you.

debug level logging verbose user. tends used developers when debugging.


Comments

Popular posts from this blog

html - How to set bootstrap input responsive width? -

javascript - Highchart x and y axes data from json -

javascript - Get js console.log as python variable in QWebView pyqt -