生活随笔
收集整理的這篇文章主要介紹了
Caffe代码导读（4）：数据集准备
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
轉載自：
Caffe代碼導讀（4）：數據集準備 - 卜居 - 博客頻道 - CSDN.NET?
?http://blog.csdn.net/kkk584520/article/details/41649281
Caffe上面有兩個比較簡單的例子：MNIST和CIFAR-10，前者是用于手寫數字識別的，后者用于小圖片分類。這兩個數據集可以在Caffe源碼框架中用腳本（CAFFE_ROOT/data/mnist/get_mnist.sh和CAFFE_ROOT/data/cifar10/get_cifar10.sh）下載，如下圖所示：
[plain] view plaincopyprint?
$?./get_cifar10.sh??Downloading...??--2014-12-02?01:20:12--??http://www.cs.toronto.edu/~kriz/cifar-10-binary.tar.gz??Resolving?www.cs.toronto.edu...?128.100.3.30??Connecting?to?www.cs.toronto.edu|128.100.3.30|:80...?connected.??HTTP?request?sent,?awaiting?response...?200?OK??Length:?170052171?(162M)?[application/x-gzip]??Saving?to:?“cifar-10-binary.tar.gz”??????100%[===========================================================================================================================================================>]?170,052,171??859K/s???in?2m?16s??????2014-12-02?01:22:28?(1.20?MB/s)?-?“cifar-10-binary.tar.gz”?saved?[170052171/170052171]??????Unzipping...??Done.??$?ls??batches.meta.txt??data_batch_1.bin??data_batch_2.bin??data_batch_3.bin??data_batch_4.bin??data_batch_5.bin??get_cifar10.sh??readme.html??test_batch.bin??
$ ./get_cifar10.sh
Downloading...
--2014-12-02 01:20:12-- ?http://www.cs.toronto.edu/~kriz/cifar-10-binary.tar.gz
Resolving www.cs.toronto.edu... 128.100.3.30
Connecting to www.cs.toronto.edu|128.100.3.30|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 170052171 (162M) [application/x-gzip]
Saving to: “cifar-10-binary.tar.gz”100%[===========================================================================================================================================================>] 170,052,171 ?859K/s ? in 2m 16s2014-12-02 01:22:28 (1.20 MB/s) - “cifar-10-binary.tar.gz” saved [170052171/170052171]Unzipping...
Done.
$ ls
batches.meta.txt ?data_batch_1.bin ?data_batch_2.bin ?data_batch_3.bin ?data_batch_4.bin ?data_batch_5.bin ?get_cifar10.sh ?readme.html ?test_batch.bin
[plain] view plaincopyprint?
$?./get_mnist.sh??Downloading...??--2014-12-02?01:24:25--??http://yann.lecun.com/exdb/mnist/train-images-idx3-ubyte.gz??Resolving?yann.lecun.com...?128.122.47.89??Connecting?to?yann.lecun.com|128.122.47.89|:80...?connected.??HTTP?request?sent,?awaiting?response...?200?OK??Length:?9912422?(9.5M)?[application/x-gzip]??Saving?to:?“train-images-idx3-ubyte.gz”??????100%[===========================================================================================================================================================>]?9,912,422???2.09M/s???in?6.7s??????2014-12-02?01:24:33?(1.42?MB/s)?-?“train-images-idx3-ubyte.gz”?saved?[9912422/9912422]??????--2014-12-02?01:24:33--??http://yann.lecun.com/exdb/mnist/train-labels-idx1-ubyte.gz??Resolving?yann.lecun.com...?128.122.47.89??Connecting?to?yann.lecun.com|128.122.47.89|:80...?connected.??HTTP?request?sent,?awaiting?response...?200?OK??Length:?28881?(28K)?[application/x-gzip]??Saving?to:?“train-labels-idx1-ubyte.gz”??????100%[===========================================================================================================================================================>]?28,881??????42.0K/s???in?0.7s??????2014-12-02?01:24:34?(42.0?KB/s)?-?“train-labels-idx1-ubyte.gz”?saved?[28881/28881]??????--2014-12-02?01:24:34--??http://yann.lecun.com/exdb/mnist/t10k-images-idx3-ubyte.gz??Resolving?yann.lecun.com...?128.122.47.89??Connecting?to?yann.lecun.com|128.122.47.89|:80...?connected.??HTTP?request?sent,?awaiting?response...?200?OK??Length:?1648877?(1.6M)?[application/x-gzip]??Saving?to:?“t10k-images-idx3-ubyte.gz”??????100%[===========================================================================================================================================================>]?1,648,877????552K/s???in?2.9s??????2014-12-02?01:24:39?(552?KB/s)?-?“t10k-images-idx3-ubyte.gz”?saved?[1648877/1648877]??????--2014-12-02?01:24:39--??http://yann.lecun.com/exdb/mnist/t10k-labels-idx1-ubyte.gz??Resolving?yann.lecun.com...?128.122.47.89??Connecting?to?yann.lecun.com|128.122.47.89|:80...?connected.??HTTP?request?sent,?awaiting?response...?200?OK??Length:?4542?(4.4K)?[application/x-gzip]??Saving?to:?“t10k-labels-idx1-ubyte.gz”??????100%[===========================================================================================================================================================>]?4,542???????19.8K/s???in?0.2s??????2014-12-02?01:24:40?(19.8?KB/s)?-?“t10k-labels-idx1-ubyte.gz”?saved?[4542/4542]??????Unzipping...??Done.??$?ls??get_mnist.sh??t10k-images-idx3-ubyte??t10k-labels-idx1-ubyte??train-images-idx3-ubyte??train-labels-idx1-ubyte??
$ ./get_mnist.sh
Downloading...
--2014-12-02 01:24:25-- ?http://yann.lecun.com/exdb/mnist/train-images-idx3-ubyte.gz
Resolving yann.lecun.com... 128.122.47.89
Connecting to yann.lecun.com|128.122.47.89|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 9912422 (9.5M) [application/x-gzip]
Saving to: “train-images-idx3-ubyte.gz”100%[===========================================================================================================================================================>] 9,912,422 ? 2.09M/s ? in 6.7s2014-12-02 01:24:33 (1.42 MB/s) - “train-images-idx3-ubyte.gz” saved [9912422/9912422]--2014-12-02 01:24:33-- ?http://yann.lecun.com/exdb/mnist/train-labels-idx1-ubyte.gz
Resolving yann.lecun.com... 128.122.47.89
Connecting to yann.lecun.com|128.122.47.89|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 28881 (28K) [application/x-gzip]
Saving to: “train-labels-idx1-ubyte.gz”100%[===========================================================================================================================================================>] 28,881 ? ? ?42.0K/s ? in 0.7s2014-12-02 01:24:34 (42.0 KB/s) - “train-labels-idx1-ubyte.gz” saved [28881/28881]--2014-12-02 01:24:34-- ?http://yann.lecun.com/exdb/mnist/t10k-images-idx3-ubyte.gz
Resolving yann.lecun.com... 128.122.47.89
Connecting to yann.lecun.com|128.122.47.89|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1648877 (1.6M) [application/x-gzip]
Saving to: “t10k-images-idx3-ubyte.gz”100%[===========================================================================================================================================================>] 1,648,877 ? ?552K/s ? in 2.9s2014-12-02 01:24:39 (552 KB/s) - “t10k-images-idx3-ubyte.gz” saved [1648877/1648877]--2014-12-02 01:24:39-- ?http://yann.lecun.com/exdb/mnist/t10k-labels-idx1-ubyte.gz
Resolving yann.lecun.com... 128.122.47.89
Connecting to yann.lecun.com|128.122.47.89|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 4542 (4.4K) [application/x-gzip]
Saving to: “t10k-labels-idx1-ubyte.gz”100%[===========================================================================================================================================================>] 4,542 ? ? ? 19.8K/s ? in 0.2s2014-12-02 01:24:40 (19.8 KB/s) - “t10k-labels-idx1-ubyte.gz” saved [4542/4542]Unzipping...
Done.
$ ls
get_mnist.sh ?t10k-images-idx3-ubyte ?t10k-labels-idx1-ubyte ?train-images-idx3-ubyte ?train-labels-idx1-ubyte
如果你下載出現問題可以從我的資源處獲取，網址http://download.csdn.net/detail/kkk584520/8213463。
原始數據集為二進制文件，需要轉換為leveldb或lmdb才能被Caffe識別。轉換格式的工具已經集成在Caffe代碼中，見CAFFE_ROOT/examples/mnist/convert_mnist_data.cpp
和CAFFE_ROOT/examples/cifar10/convert_cifar_data.cpp，如果對leveldb或lmdb操作不熟悉可以從這兩個源代碼中學習。我們只需要在CAFFE_ROOT目錄中執行兩條命令即可：
./examples/mnist/create_mnist.sh
./examples/cifar10/create_cifar10.sh
總結
以上是生活随笔為你收集整理的Caffe代码导读（4）：数据集准备的全部內容，希望文章能夠幫你解決所遇到的問題。
如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。
