Skip to content

rajeshbalamohan/dfs_benchmark

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 

Repository files navigation

mvn clean package

Create test data:
=================
for i in `seq 1 1000`; do echo $i > ./$i.txt; done

hadoop dfs -put ./test /tmp/

To Run:
=======
specify the number of threads and the directory you would like to scan (recursive mode supported).
e.g following would spawn 60 threads and each of them would scan /tmp/test directory

java -cp /grid/0/hadoopConf/:./target/lib/*:./target/*: DFSBenchmark 60 /tmp/test/

About

Simple DFS benchmark to test file open with many threads

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •  

Languages