精华内容
下载资源
问答
  • weedfs

    2015-10-27 13:54:28
    1

    1.weed.tar.gz  解压即用

    启动: cd /usr/local/weed/ && sh start.sh

    停止: killall weed


    start.sh中的内容如下:

    /usr/local/weed/bin/weed  -alsologtostderr=true -v=0 -log_dir="/data/logs/weed/m1" master -mdir=/usr/local/weed/m1 -port=9333 -ip="112.74.29.204" & 
    /usr/local/weed/bin/weed volume -max=100 -mserver=112.74.29.204:9333 -dir=/data/weed/f1/ -port=8181 -ip=112.74.29.204 -publicUrl=112.74.29.204:8181 -dataCenter=f1 &

    展开全文
  • weedfs client

    2019-07-28 20:56:54
    weedFS Client For Java Features SeaweedFSis a simple and highly scalable distributed file system and started by implementingFacebook's Haystack design paper. SeaweedFS is currently growing, with m.....

    weedFS Client For Java

    Features

    SeaweedFS is a simple and highly scalable distributed file system and started by implementing Facebook's Haystack design paper. SeaweedFS is currently growing, with more features on the way.

    This Java client is encapsulates the functionality full of the SeaweedFS API and provides a simple interface.

    For performance, we make some progress:

    • Include Ehcache and used it for cached lookup volume.
    • Include HttpClient Connection Pool for handle HTTP request.
    • Volume server location load balance.
    • Heuristic cache is used for fetch file stream.
    • Auto switch leader server (master) at failover.

    Quick Start

    Maven

    <dependency>
      <groupId>org.lokra.seaweedfs</groupId>
      <artifactId>seaweedfs-client</artifactId>
      <version>0.7.3.RELEASE</version>
    </dependency>

    Gradle

    repositories {
        mavenCentral()
    }
    
    dependencies {
        compile('org.lokra.seaweedfs:seaweedfs-client:0.7.3.RELEASE')
    }
    

    Create a connection manager

    FileSource fileSource = new FileSource();
    // SeaweedFS master server host
    fileSource.setHost("localhost");
    // SeaweedFS master server port
    fileSource.setPort(9333);
    // Startup manager and listens for the change
    fileSource.startup();

    Create a file operation template

    // Template used with connection manager
    FileTemplate template = new FileTemplate(fileSource.getConnection());
    template.saveFileByStream("filename.doc", someFile);

    License

    The MIT License (MIT)

    Copyright (c) 2016 Lokra Studio

    Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

    The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

    THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

    展开全文
  • weedfs安装使用

    2020-12-24 09:48:37
    weedfs 参考: seaweedfs官网 分布式小文件系统fastdfs与weedfs的对比 初窥weedfs分布式文件系统 看:Seaweedfs的安装和使用–研究 看:seaweedfs使用说明 看:seaweedfs文件存储服务器搭建 Seaweedfs 详细说明 ...

    weedfs

    参考:

    seaweedfs官网

    分布式小文件系统fastdfs与weedfs的对比

    初窥weedfs分布式文件系统

    看:Seaweedfs的安装和使用–研究

    看:seaweedfs使用说明

    看:seaweedfs文件存储服务器搭建

    Seaweedfs 详细说明

    filer使用:seaweedfs安装配置使用

    weed-fs使用简介

    seaweedfs 用docker快速布署及测试

    http://blog.chinaunix.net/uid-29677448-id-5602995.html

    java使用https://github.com/HalfWater/seaweedfs-java-client(自己下载编译)

    weedfs的简易安装以及使用Java编写的简单上传代码

    网上安装步骤

    1、下载weedfs:https://github.com/chrislusf/seaweedfs/releases

    wget https://github.com/chrislusf/seaweedfs/releases/download/2.14/linux_amd64.tar.gz

    mkdir -p /usr/local/weedfs/ cd /usr/localweedfs/

    mkdir -p /home/yyt/weedfs/

    /weedfs目录

    tar -xzvf linux_amd64.tar.gz

    mkdir -p /data/weedfs_data
    mkdir -p /data/weedfs_data/vol{a..c}
    mkdir -p /data/weedfs_data/master
    mkdir -p /data/weedfs_data/filter
    
    
    nohup ./weed master -mdir=/root/sea/data -port=9333 -ip="172.16.20.71" &>> /root/sea/logs/master.log &
    
    ------------------
    ./weed volume -dir="D:\data1" -max=500 -mserver="localhost:9333" -port=9331 &>>/root/sea/logs/vol1.log &
    
    ./weed volume -dir="D:\data2" -max=500 -mserver="localhost:9333" -port=9332
    &>>/root/sea/logs/vol1.log &
    
    volume默认最大7个,你可以设置100等等。。。
    -master.volumeSizeLimitMB 默认最大30000000 (30G)
    -filer.dir 目录来存储元数据,默认为指定-dir的“filer”子目录
    -master.dir用于存储元数据的数据目录,默认为与指定的-dir相同
    
    
    ./weed -log_dir='/path/to/seaweedfs/master/logs'  master  -defaultReplication="001" -mdir="./master"  -peers="1.1.2.2:9333"  -volumeSizeLimitMB=10  
    
    ./weed  -log_dir='/path/to/seaweedfs/volume/logs'  volume -dir="volume" -ip="1.1.2.3" -max="3" -mserver='1.1.2.2:9333'  -rack='rack2' 
    

    建议在启动服务时都指定一下log_dir, 否则使用的默认值是/tmp目录, 生成的文件较多, 很难看.

    docker环境搭建

    https://blog.csdn.net/weixin_34380296/article/details/92359656

    ps -ef | grep weed
    
    docker rm -f master ; docker rm -f volume
    
    #docker ps -n 4
    
    cd /home/yyt/weedfs/data ;du -sh *
    
    # 创建文件夹
    rm -rf /home/yyt/weedfs/data && \
    mkdir -p /home/yyt/weedfs/data/master && \
    mkdir -p /home/yyt/weedfs/data/vol1
    
    #用这条命令,开启一个master
    docker run -d --restart=always \
    -p 9333:9333 \
    --name master \
    -v /home/yyt/weedfs/data/master:/data \
    chrislusf/seaweedfs \
    master \
    -ip="10.60.0.22"
    
    #用这条命令,开一个volume,master不用写成ip
    docker run -d --restart=always \
    -v /home/yyt/weedfs/data/vol1:/data \
    -p 8089:8080 -p 18080:18080 \
    --name volume \
    --link master \
    chrislusf/seaweedfs \
    volume \
    -max=15 -mserver="master:9333" -port=8080 \
    -publicUrl="10.60.0.22:8089"
    
    
    docker run -d --restart=always \
    -p 8089:8089 -p 18080:18080 \
    --name volume1 \
    --link master \
    chrislusf/seaweedfs \
    volume \
    -max=15 -mserver="10.60.0.23:9333" -port=8089
    
    # 可以创建第二个volume
    docker run -d --restart=always \
    -p 8090:8090 -p 18080:18080 \
    --name volume2 \
    chrislusf/seaweedfs \
    volume -volumeSizeLimitMB=10 -mserver="master:9333" -port=8090 
    
    # 访问
    http://10.60.0.23:9333/
    

    docker-compose方式搭建

    docker-compose搭建:
    debian8 
    python2.7 
    docker17.04 
    docker-compose1.12.0
    
    1)git clone https://github.com/chrislusf/seaweedfs.git
    2)cd seaweedfs/docker
    3)docker build -t sunsl/seaweedfs .
    4)修改docker-compose.yml中的 image 为 sunsl/seaweedfs
    5)docker-compose up
    

    参考docker-compose.yml

    version: '2'
    
    services:
      master:
        image: chrislusf/seaweedfs # use a remote image
        volumes:
          - $PWD/out:/etc/seaweedfs/out
          - $PWD/security.toml:/etc/seaweedfs/security.toml
          - $PWD/filer.toml:/etc/seaweedfs/filer.toml
          - /var/yr/seaweedfs_data/master:/data
        # ports:
        #   - 9333:9333
        #   - 19333:19333
        command: "master"
        restart: always
        networks:
          seaweedfs_network:
    
      volume:
        image: chrislusf/seaweedfs # use a remote image
        volumes:
          - $PWD/out:/etc/seaweedfs/out
          - $PWD/security.toml:/etc/seaweedfs/security.toml
          - $PWD/filer.toml:/etc/seaweedfs/filer.toml
          - /var/yr/seaweedfs_data/node1:/data
        # ports:
        #   - 8080:8080
        #   - 18080:18080
        command: 'volume -max=45 -index=leveldb -mserver="master:9333" -port=8080'
        depends_on:
          - master
        restart: always
        networks:
          seaweedfs_network:
    
      filer:
        image: chrislusf/seaweedfs # use a remote image
        volumes:
          - $PWD/out:/etc/seaweedfs/out
          - $PWD/security.toml:/etc/seaweedfs/security.toml
          - $PWD/filer.toml:/etc/seaweedfs/filer.toml
          - /var/yr/seaweedfs_data/filerdb:/data/filerdb
    #    ports:
    #      - 8880:8888
    #      - 18880:18888
        command: 'filer -master="master:9333" -collection "finance"'
        # tty: true
        # stdin_open: true
        depends_on:
          - master
          - volume
          - mysql
        restart: always
        networks:
          seaweedfs_network:
    
      nxinx:
        image: nginx:alpine
        volumes:
          - $PWD/pwd:/pwd
          - $PWD/nginx.conf:/etc/nginx/nginx.conf
        links:
          - filer
        ports:
          - 8600:80
        restart: always
        networks:
          seaweedfs_network:
    
      mysql:
        image: mysql:latest
        environment:
          - MYSQL_ROOT_PASSWORD=lambdax
          - MYSQL_USER=finance
          - MYSQL_PASSWORD=shuzhi2019
          - MYSQL_DATABASE=seaweedfs_finance_filer
        volumes:
          - /var/yr/seaweedfs_data/mysql_data:/var/lib/mysql
        ports:
          - "8599:3306"
        restart: always
        networks:
          seaweedfs_network:
    
      # cronjob:
      #   image: chrislusf/seaweedfs # use a remote image
      #   volumes:
      #     - ./out:/etc/seaweedfs/out
      #     - ./security.toml:/etc/seaweedfs/security.toml
      #     - ./filer.toml:/etc/seaweedfs/filer.toml
      #   # ports:
      #   command: 'cronjob'
      #   environment:
      #     # Run re-replication every 2 minutes
      #     CRON_SCHEDULE: '*/2 * * * * *' # Default: '*/5 * * * * *'
      #     WEED_MASTER: master:9333 # Default: localhost:9333
      #   depends_on:
      #   - master
      #   - volume
        # restart: always
        # networks:
        #   seaweedfs_network:
    
    
    networks:
       seaweedfs_network:
          ipam:
             config:
             - subnet: 192.168.10.0/24
               gateway: 192.168.10.111
    
    
    

    API使用

    1)获取Fid和URL
    # curl "http://localhost:9333/dir/assign?replication=001"
    curl -X POST http://localhost:9333/dir/assign
    {"fid":"1,0240cd0175","url":"172.18.0.3:8080","publicUrl":"172.18.0.3:8080","count":1}
    
    #申请带存活时间的fid 
    # ttl string 存活时间 1m,1h,1d,1M,1y
    # 获取fid带ttl的 http://localhost:9333/dir/assign?ttl=2m
    # 获取上传带ttl的 http://localhost:9333/5,01d8f2bc3c?ttl=2m
    # 取fid带ttl的时间要大于等于上传带ttl的时间
    
    # 上传
    curl -F file=@qs.png http://192.168.2.101:9333/5,01d8f2bc3c
    
    # 查看
    GET http://192.168.2.101:9333/5,01d8f2bc3c
    
    # 查看卷
    # curl -X get http://192.168.0.193:9333/dir/lookup?volumeId=8
    GET http://localhost:9333/dir/lookup?volumeId=40
    {
        "volumeId": "40",
        "locations": [
            {
                "url": "192.168.10.212:8082",
                "publicUrl": "192.168.10.212:8082"
            }
        ]
    }
    
    # 查看卷信息
    http://localhost:8081/status?pretty=y
    http://localhost:8082/status?pretty=y
    
    # 压缩空间
    http://localhost:9333/vol/vacuum
    

    监控

    (1)tcp端口监控
    
    (2)测试写入, 每1分钟写入1次
    [{"fileName":"/tmp/anaconda-post.log","error":"Post http://172.17.0.7:9333/dir/assign: dial tcp 172.17.0.7:9333: connection refused"}]  不正常的返回结果
    [{"fileName":"abc.txt","fileUrl":"172.17.0.8:8080/9,01b16f4a4c2f","fid":"9,01b16f4a4c2f","size":83}]    正常的返回结果
    
    (3)各master的 http://172.17.0.8:9333/cluster/status?pretty=y 结果, 必须要有Leader,且同一组master服务器的Leader值要相同.另外因为线上是按3个master部署的, 所以Peers中要有2个才对.   监控这一条是为了保证在出现一个master异常时, 其它master可以自动切换, 否则几个master之间的状态已经不对了, 当主master故障时就没有办法自动切换了.
    
    (4)curl "http://172.17.0.8:9333/dir/status?pretty=y"  检查DataNodes的数量, 这个值表示的是从master中查看到的DataNode的数量. 如果连续2次获取到的DataNode数量不相同, 则表明有节点down机或新扩容了节点
    

    搭建

    window环境搭建

    weed.exe master -mdir=f:\data -port=9333 -ip="localhost"
    
    weed.exe volume -dir="f:\vol" \
    -max=4 \
    -mserver="localhost:9333" -port=8083
    

    linux环境搭建

    一、安装
    1、首先安装配置golang开发环境
    go的最新版本是1.9.1 可到
    https://storage.googleapis.com/golang/go1.9.1.linux-amd64.tar.gz
    下载 go1.9.1.linux-amd64.tar.gz
    2、上传并解压到指定目录 
    sudo tar -xzf go1.9.1.linux-amd64.tar.gz -C /opt
    3、配置环境变量
    vim /etc/profile
    export GOROOT=/usr/local/go
    export PATH=$GOROOT/bin:$PATH
    #export GOPATH=$GORROT/workspace
    
    source /etc/profile
    
    #4、创建文件夹可以直接从这步开始
    mkdir -p /home/yyt/weedfs/data/ && \
    mkdir -p /home/yyt/weedfs/data/vol1 && \
    mkdir -p /home/yyt/weedfs/data/vol2 && \
    mkdir -p /home/yyt/weedfs/data/master && \
    mkdir -p /home/yyt/weedfs/data/filer
    
    rm -rf /home/yyt/weedfs/data && \
    mkdir -p /home/yyt/weedfs/data/master && \
    mkdir -p /home/yyt/weedfs/data/vol1
    
    # 查看
    netstat -lnp | grep 9333
    ps -ef | grep weed
    
    #5、启动master当前目录要使用./weed执行
    nohup /home/yyt/weedfs/weed master -mdir=/home/yyt/weedfs/data/master -port=9333 -ip="10.60.0.22" &>>/home/yyt/weedfs/data/master/master.log &
    # 查看日志
    cat /home/yyt/weedfs/data/master/master.log
    
    #6、启动vol1
    nohup /home/yyt/weedfs/weed volume -dir="/home/yyt/weedfs/data/vol1" \
    -max=15 \
    -mserver="192.168.10.212:9333" -port=8081 \
    &>>/home/yyt/weedfs/data/vol1/vol1.log &
    
    #cat /home/yyt/weedfs/data/vol2/vol2.log
    #7、 启动vol2
    nohup /home/yyt/weedfs/weed volume -dir="/home/yyt/weedfs/data/vol2" \
    -max=15 \
    -fileSizeLimitMB=8 \
    -mserver="192.168.10.212:9333" -port=8082 \
    &>>/home/yyt/weedfs/data/vol2/vol2.log &
    
    #关闭 ps -ef | grep weedfs | grep -v grep | awk '{print $2 }' | xargs kill
    #------------------扩展
    mkdir -p /home/yyt/weedfs/data/filer/leveldb2
    #启动filer 生成一个配置文件filer.toml
    /home/yyt/weedfs/weed scaffold -config=filer -output=. 
    #修改filer.toml,把filer的数据目录的dir指向到/home/yyt/weedfs/data/filer/leveldb2下
    vi /home/yyt/weedfs/filer.toml
    #然后启动filer
    nohup /home/yyt/weedfs/weed filer -port=8888  -master=localhost:9333 &>> /home/yyt/weedfs/data/filer/filer.log &
    
    # mount挂载(一般不用,因为使用的容量是双倍的)
    mkdir -p /home/yyt/weedfs/data/newfilermount/data
    yum install -y fuse
    
    nohup /home/yyt/weedfs/weed mount -filer=localhost:8888 -dir=/home/yyt/weedfs/data/newfilermount/data &>> /home/yyt/weedfs/data/newfilermount/wefsmount.log &
    
    #filer的mount 为了方便本地操作,把一个collection里面的内容挂载导某个目录,方便操作
    #post 上传图片http://192.168.10.212:8888/path/to/sources/20150429093808_83019.jpg
    #关闭挂在需要关闭mount并且手动umont ~/wz/mdir目录,如果一般用户失败请使用root用户
    
    #使用fid上传挂载目录看不到,挂载的目录大小还是不变
    #使用/path/to/sources上传,挂载和volum大小都会增加(相当于双倍使用磁盘容量,只能用1半的容器量了),但是删除操作2个空间都会也立马释放不用在压缩了。
    #所有操作都可以访问:http://192.168.10.212:9333/
    

    总结

    启动脚本

    sh /home/yyt/weedfs/bin/start_weedfs.sh

    #!/bin/bash
    
    # master
    nohup /home/yyt/weedfs/weed master -mdir=/home/yyt/weedfs/data/master -port=9333 -ip="192.168.10.212" &>>/home/yyt/weedfs/data/master/master.log &
    
    # vol1
    nohup /home/yyt/weedfs/weed volume -dir="/home/yyt/weedfs/data/vol1" \
    -max=15 \
    -fileSizeLimitMB=8 \
    -mserver="192.168.10.212:9333" -port=8081 \
    &>>/home/yyt/weedfs/data/vol1/vol1.log &
    
    # vol2
    nohup /home/yyt/weedfs/weed volume -dir="/home/yyt/weedfs/data/vol2" \
    -max=15 \
    -fileSizeLimitMB=8 \
    -mserver="192.168.10.212:9333" -port=8082 \
    &>>/home/yyt/weedfs/data/vol2/vol2.log &
    

    sh /home/yyt/weedfs/bin/stop_weedfs.sh

    #!/bin/bash
    
    ps -ef | grep weedfs | grep -v grep | awk '{print $2 }' | xargs kill
    echo "weedfs stop"
    

    查看容量大小

    cd /home/yyt/weedfs/data ;du -sh *
    

    配置开机启动

    开机启动
    Centos 7
    vi /etc/rc.d/rc.local
    /xx.sh
    chmod +x xx.sh
    
    
    UBUNTU
    vi /etc/rc.local
    
    
    启动脚本的创建
    现在我们以安装nginx为例,假设我们的nginx安装在/usr/sbin/目录下。
    - 首先,我们在/etc/init.d创建文件sudo vim nginx,并将shell代码拷贝进去。
    - 修改文件权限为755 sudo chmod 755 nginx。
    - 添加服务到启动过程 sudo update-rc.d nginx defaults。
    
    sudo update-rc.d start_weedfs.sh defaults
    现在,我们就可以用以下命令正常启动nginx了。
    
    # 启动
    /etc/init.d/nginx start
    # 停止
    /etc/init.d/nginx stop
    # 重启
    /etc/init.d/nginx restart
    

    笔记

    weedfs删除比较麻烦,可使用过期删除,但是一直上传使用的情况下不会自动压缩空间(手动测试不出来,可能是上传的频率没有这么高,会自动压缩空间)。

    可以创建2对master和volume用定时器切换存储达到不服务自动瘦身的效果。

    空间占用少时不会可能不会压缩,可以手动调用压缩的url进行压缩,压缩效果不会马上看出有延时,好像最多10分钟之内会自动完成。

          // ip:9333/vol/vacuum
         restTemplate.getForObject(Constant.picAccessIpPortWeedFS + "/vol/vacuum", Object.class);
    
    展开全文
  • WeedFS依赖库 0.6.1

    2019-10-05 12:01:05
    WeedFS依赖库 版本 0.6.1 =======================================================================glog=======================================================================...

    WeedFS依赖库

    版本 0.6.1

    =======================================================================
    glog
    =======================================================================
    http://code.google.com/p/google-glog

    This is an efficient pure Go implementation of leveled logs in the
    manner of the open source C++ package

    =======================================================================
    rwcarlsen/goexif
    =======================================================================
    github.com/rwcarlsen/goexif

    Provides decoding of basic exif and tiff encoded data. Still in alpha - no guarantees. Suggestions and pull requests are welcome. Functionality is split into two packages - "exif" and "tiff" The exif package depends on the tiff package. Documentation can be found at http://godoc.org/github.com/rwcarlsen/goexif

    =======================================================================
    disintegration/imaging
    =======================================================================
    https://github.com/disintegration/imaging

    Package imaging provides basic image manipulation functions (resize, rotate, flip, crop, etc.). This package is based on the standard Go image package and works best along with it.

    =======================================================================
    goprotobuf
    =======================================================================
    code.google.com/p/goprotobuf/proto

    This package provides Go support, in the form of a library and protocol compiler plugin, for Google's protocol buffers. (RPC is not supported.)

    To install it, you must first have Go (version 1.1) installed (see http://golang.org/doc/install). Next, install the standard protocol buffer implementation from http://code.google.com/p/protobuf/; you must be running version 2.5.0 or higher.

    =======================================================================
    tgulacsi/go-cdb
    =======================================================================
    https://github.com/tgulacsi/go-cdb

    cdb.go is a Go package to read and write cdb ("constant database") files.

    See the original cdb specification and C implementation by D. J. Bernstein at http://cr.yp.to/cdb.html.

    =======================================================================
    goraft/raft
    =======================================================================
    github.com/goraft/raft

    This is a Go implementation of the Raft distributed consensus protocol. Raft is a protocol by which a cluster of nodes can maintain a replicated state machine. The state machine is kept in sync through the use of a replicated log.

    =======================================================================
    syndtr/goleveldb
    =======================================================================
    github.com/syndtr/goleveldb/leveldb

    This is an implementation of the LevelDB key/value database in the Go programming language.

    =======================================================================
    gorilla/mux
    =======================================================================
    https://github.com/gorilla/mux

    gorilla/mux is a powerful URL router and dispatcher.

    =======================================================================
    bazillion/fuse
    =======================================================================
    http://bazil.org/fuse/

    It is a from-scratch implementation of the kernel-userspace communication protocol, and does not use the C library from the project called FUSE. bazil.org/fuse embraces Go fully for safety and ease of programming.

    转载于:https://www.cnblogs.com/forrestsun/p/3816429.html

    展开全文
  • 最近拿一台双核1G的kvm vps搭建了一个图片的服务器,前面用百度云加速扛着...总结一下最近接触过的两个分布式小文件系统weedfs和fastdfs。 fastdfs的详细介绍看这里=》 传送门 weedfs官方地址= &gt;传送门...
  • WeedFS0.6.8-引用库列表

    2019-10-05 12:03:31
    WeedFS 0.68新增了对cassandra数据库存储的支持及JSON Web Token(JWTs)安全的支持. github.com/gocql/gocql //filer/cassandra_store/cassandra_store.go github....
  • Nginx+Lua+WeedFS安装手记

    千次阅读 2016-06-13 10:09:09
    安装手记 首先下载WeedFS https://bintray.com/chrislusf/Weed-FS/weed 下载最新的WeedFS Server tar zxvf weed_0.57_linux_amd64.tar.gz 启动Master server 以及 volume ser
  • dir=/weedfs_data -mserver=192.168.0.193:9333 -port=8083 -ip=`hostname -i` 文件写入 要上传文件:首先,向/ dir / assign发送HTTP POST,PUT或GET请求以获取fid和卷服务器url > curl -X POST ...
  • 分布式文件服务器seadweedfs,以二进制方式存储文件,可上传并下载
  • weedfs是一个适用于需要存储大量小文件的一个分布式文件系统,全名为Seaweed-fs,是一个使用go语言开发的简单的高可用的系统。开创之初weedfs是源于一篇Facebook的论文实现,下面介绍在服务器中的安装部署步骤。一、...
  • WeedFS问题收集

    2019-10-05 12:01:04
    weed fs FAQ Moving files to a different server Q: Hello,is it possible to move manually the .dat and .idx to a different volume? ...Moving it to a different volume server?... Steps: 1....
  • weedfs 性能测试 机器A 192.168.174.129 Intel(R) Xeon(R) CPU E5-4620 0 @ 2.20GHz cpu cores : 8 SMT:8 64核 MEM : 132G 机器B192.168.174.130 Intel(R) Xeon(R) CPU E7- 4807 @ 1.87GHz cpu cores ...
  • weedfs文件使用记录

    2020-05-15 17:18:15
    源码目录结构 核心模块 weed 入口目录 ... topology 核心模块,主要包括 【DataCenter, Rack, DataNode】 三层拓扑结构。 storage 核心模块,主要包括【Store, Volume, Needle】这三大块存储相关的源码。...
  • WeedFS 源码分析

    2015-01-11 08:18:03
    /storage/volume_ttl.go type TTL struct { count byte unit byte } 由数值和单位构成,从说明文档来看,单位支持m, h, d, w, M, y。 .../storage/replica_placement.go ...type ReplicaPlacement s...
  • centos weedfs安装配置

    千次阅读 2017-11-16 14:29:24
    下载 https: //github .com /chrislusf/seaweedfs/releases/download/ 0.76 /linux_amd64 .tar .gz 这里下载 linux_amd64版本 ...weedfs 操作 详见官方文档: https://github.com/chrislusf/seaweedfs
  • 启动master weed master -ip 10.191.197.133 -mdir /namenode -ip.bind 10.191.197.133 I0809 16:53:51 7721 file_util.go:20] Folder /namenode Permission: -rwxr-xr-x I0809 16:53:51 7721 master_serv...
  • SeaweedFS是基于go语言开发的高可用文件存储系统,主要特性1、成存储上亿的文件(最终受制于你的硬盘大小)2、速度快,内存占用小上手使用比fastDFS要简单很多,自带Rest API。SaaWeeDFS作为对象存储库来有效地处理小...
  • mv ~/woring/lua-resty-weedfs/weedfs.lua ./weedfs.lua 创建 www-data 组和用户,创建路径/home/wwwroot/weedfs. nginx.conf 如下: user www-data www-data; worker_processes 8; daemon on; master_...

空空如也

空空如也

1 2 3
收藏数 45
精华内容 18
关键字:

weedfs