You are browsing a read-only backup copy of Wikitech. The primary site can be found at wikitech.wikimedia.org

User:Razzi/Analytics notes

From Wikitech-static
Jump to navigation Jump to search

Stat boxes, for example stat1008, can act as a hadoop client.

razzi@stat1008:~$ hdfs dfs -ls /wmf
Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF-8
Found 5 items
drwxr-xr-x   - analytics        analytics-privatedata-users          0 2021-02-22 12:30 /wmf/camus
drwxr-xr-x   - hdfs             hadoop                               0 2020-01-08 20:04 /wmf/data
drwxrwxr-x   - analytics-search analytics-search-users               0 2021-02-23 01:07 /wmf/discovery
drwxr-xr-x   - hdfs             hadoop                               0 2021-04-20 15:43 /wmf/refinery
drwxr-xr-x   - hdfs             hadoop                               0 2021-01-20 17:23 /wmf/tmp