おバンザーイ

Hadoop

動いたログ

$ bin/hadoop jar hadoop-0.18.3-examples.jar grep input output 'dfs[a-z.]+'
10/01/27 13:29:23 INFO mapred.FileInputFormat: Total input paths to process : 11
10/01/27 13:29:23 INFO mapred.FileInputFormat: Total input paths to process : 11
10/01/27 13:29:25 INFO mapred.JobClient: Running job: job_201001271328_0001
10/01/27 13:29:26 INFO mapred.JobClient:  map 0% reduce 0%
10/01/27 13:29:40 INFO mapred.JobClient:  map 16% reduce 0%
10/01/27 13:29:49 INFO mapred.JobClient:  map 33% reduce 5%
10/01/27 13:29:57 INFO mapred.JobClient:  map 50% reduce 5%
10/01/27 13:30:02 INFO mapred.JobClient:  map 50% reduce 11%
10/01/27 13:30:07 INFO mapred.JobClient:  map 58% reduce 13%
10/01/27 13:30:09 INFO mapred.JobClient:  map 66% reduce 16%
10/01/27 13:30:21 INFO mapred.JobClient:  map 83% reduce 22%
10/01/27 13:30:37 INFO mapred.JobClient:  map 83% reduce 27%
10/01/27 13:30:39 INFO mapred.JobClient:  map 91% reduce 27%
10/01/27 13:30:40 INFO mapred.JobClient:  map 100% reduce 27%
10/01/27 13:30:53 INFO mapred.JobClient:  map 100% reduce 33%
10/01/27 13:30:57 INFO mapred.JobClient: Job complete: job_201001271328_0001
10/01/27 13:30:57 INFO mapred.JobClient: Counters: 16
10/01/27 13:30:57 INFO mapred.JobClient:   File Systems
10/01/27 13:30:57 INFO mapred.JobClient:     HDFS bytes read=48387
10/01/27 13:30:57 INFO mapred.JobClient:     HDFS bytes written=1907
10/01/27 13:30:57 INFO mapred.JobClient:     Local bytes read=1549
10/01/27 13:30:57 INFO mapred.JobClient:     Local bytes written=3736
10/01/27 13:30:57 INFO mapred.JobClient:   Job Counters
10/01/27 13:30:57 INFO mapred.JobClient:     Launched reduce tasks=1
10/01/27 13:30:57 INFO mapred.JobClient:     Launched map tasks=12
10/01/27 13:30:57 INFO mapred.JobClient:     Data-local map tasks=12
10/01/27 13:30:57 INFO mapred.JobClient:   Map-Reduce Framework
10/01/27 13:30:57 INFO mapred.JobClient:     Reduce input groups=49
10/01/27 13:30:57 INFO mapred.JobClient:     Combine output records=100
10/01/27 13:30:57 INFO mapred.JobClient:     Map input records=1554
10/01/27 13:30:57 INFO mapred.JobClient:     Reduce output records=49
10/01/27 13:30:57 INFO mapred.JobClient:     Map output bytes=1558
10/01/27 13:30:57 INFO mapred.JobClient:     Map input bytes=47620
10/01/27 13:30:57 INFO mapred.JobClient:     Combine input records=107
10/01/27 13:30:57 INFO mapred.JobClient:     Map output records=56
10/01/27 13:30:57 INFO mapred.JobClient:     Reduce input records=49
10/01/27 13:30:57 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applic
tions should implement Tool for the same.
10/01/27 13:30:58 INFO mapred.FileInputFormat: Total input paths to process : 1
10/01/27 13:30:58 INFO mapred.FileInputFormat: Total input paths to process : 1
10/01/27 13:30:59 INFO mapred.JobClient: Running job: job_201001271328_0002
10/01/27 13:31:00 INFO mapred.JobClient:  map 0% reduce 0%
10/01/27 13:31:05 INFO mapred.JobClient:  map 100% reduce 0%
10/01/27 13:31:11 INFO mapred.JobClient: Job complete: job_201001271328_0002
10/01/27 13:31:11 INFO mapred.JobClient: Counters: 16
10/01/27 13:31:11 INFO mapred.JobClient:   File Systems
10/01/27 13:31:11 INFO mapred.JobClient:     HDFS bytes read=1907
10/01/27 13:31:11 INFO mapred.JobClient:     HDFS bytes written=1135
10/01/27 13:31:11 INFO mapred.JobClient:     Local bytes read=1549
10/01/27 13:31:11 INFO mapred.JobClient:     Local bytes written=3134
10/01/27 13:31:11 INFO mapred.JobClient:   Job Counters
10/01/27 13:31:11 INFO mapred.JobClient:     Launched reduce tasks=1
10/01/27 13:31:11 INFO mapred.JobClient:     Launched map tasks=1
10/01/27 13:31:11 INFO mapred.JobClient:     Data-local map tasks=1
10/01/27 13:31:11 INFO mapred.JobClient:   Map-Reduce Framework
10/01/27 13:31:11 INFO mapred.JobClient:     Reduce input groups=3
10/01/27 13:31:11 INFO mapred.JobClient:     Combine output records=0
10/01/27 13:31:11 INFO mapred.JobClient:     Map input records=49
10/01/27 13:31:11 INFO mapred.JobClient:     Reduce output records=49
10/01/27 13:31:11 INFO mapred.JobClient:     Map output bytes=1429
10/01/27 13:31:11 INFO mapred.JobClient:     Map input bytes=1821
10/01/27 13:31:11 INFO mapred.JobClient:     Combine input records=0
10/01/27 13:31:11 INFO mapred.JobClient:     Map output records=49
10/01/27 13:31:11 INFO mapred.JobClient:     Reduce input records=49

しばらくは0.18.3で。