精华内容
参与话题
问答
  • StorageClass

    千次阅读 2019-07-15 20:30:21
    本文个人博客地址:...StorageClass 1. StorageClass概述 StorageClass提供了一种描述存储类(class)的方法,不同的class可能会映射到不同的服务质量等级和备份策略或其他策略等。 StorageClass 对象中包含...

    本文个人博客地址:https://www.huweihuang.com/kubernetes-notes/storage/storage-class.html

    StorageClass

    1. StorageClass概述

    StorageClass提供了一种描述存储类(class)的方法,不同的class可能会映射到不同的服务质量等级和备份策略或其他策略等。

    StorageClass 对象中包含 provisionerparametersreclaimPolicy 字段,当需要动态分配 PersistentVolume 时会使用到。当创建 StorageClass 对象时,设置名称和其他参数,一旦创建了对象就不能再对其更新。也可以为没有申请绑定到特定 class 的 PVC 指定一个默认的 StorageClass

    StorageClass对象文件

    kind: StorageClass
    apiVersion: storage.k8s.io/v3
    metadata:
      name: standard
    provisioner: kubernetes.io/aws-ebs
    parameters:
      type: gp2
    reclaimPolicy: Retain
    mountOptions:
      - debug
    

    2. StorageClass的属性

    2.1. Provisioner(存储分配器)

    Storage class 有一个分配器(provisioner),用来决定使用哪个卷插件分配 PV,该字段必须指定。可以指定内部分配器,也可以指定外部分配器。外部分配器的代码地址为: kubernetes-incubator/external-storage,其中包括NFSCeph等。

    2.2. Reclaim Policy(回收策略)

    可以通过reclaimPolicy字段指定创建的Persistent Volume的回收策略,回收策略包括:Delete 或者 Retain,没有指定默认为Delete

    2.3. Mount Options(挂载选项)

    由 storage class 动态创建的 Persistent Volume 将使用 class 中 mountOptions 字段指定的挂载选项。

    2.4. 参数

    Storage class 具有描述属于 storage class 卷的参数。取决于分配器,可以接受不同的参数。 当参数被省略时,会使用默认值。

    例如以下使用Ceph RBD

    kind: StorageClass
    apiVersion: storage.k8s.io/v3
    metadata:
      name: fast
    provisioner: kubernetes.io/rbd
    parameters:
      monitors: 30.36.353.305:6789
      adminId: kube
      adminSecretName: ceph-secret
      adminSecretNamespace: kube-system
      pool: kube
      userId: kube
      userSecretName: ceph-secret-user
      fsType: ext4
      imageFormat: "2"
      imageFeatures: "layering"
    

    对应的参数说明

    • monitors:Ceph monitor,逗号分隔。该参数是必需的。

    • adminId:Ceph 客户端 ID,用于在池(ceph pool)中创建映像。 默认是 “admin”。

    • adminSecretNamespace:adminSecret 的 namespace。默认是 “default”。

    • adminSecret:adminId 的 Secret 名称。该参数是必需的。 提供的 secret 必须有值为 “kubernetes.io/rbd” 的 type 参数。

    • pool: Ceph RBD 池. 默认是 “rbd”。

    • userId:Ceph 客户端 ID,用于映射 RBD 镜像(RBD image)。默认与 adminId 相同。

    • userSecretName:用于映射 RBD 镜像的 userId 的 Ceph Secret 的名字。 它必须与 PVC 存在于相同的 namespace 中。该参数是必需的。 提供的 secret 必须具有值为 “kubernetes.io/rbd” 的 type 参数,例如以这样的方式创建:

      kubectl create secret generic ceph-secret --type="kubernetes.io/rbd" \
        --from-literal=key='QVFEQ1pMdFhPUnQrSmhBQUFYaERWNHJsZ3BsMmNjcDR6RFZST0E9PQ==' \
        --namespace=kube-system
      
    • fsType:Kubernetes 支持的 fsType。默认:“ext4”。

    • imageFormat:Ceph RBD 镜像格式,”1” 或者 “2”。默认值是 “1”。

    • imageFeatures:这个参数是可选的,只能在你将 imageFormat 设置为 “2” 才使用。 目前支持的功能只是 layering。 默认是 ““,没有功能打开。

    参考文章:

    展开全文
  • 在tracker服务上运行如下代码 fdfs_monitor /etc/fdfs/storage.conf 如下提示:

    在tracker服务上运行如下代码 

    fdfs_monitor /etc/fdfs/storage.conf

    如下提示: 

    展开全文
  • 最近做一个项目,使用到了把文件上传到google storage和把数据存到bigquery的功能。但是这时候出现了一个很奇怪的问题,我把我的上传到google storage的java项目打包成了一个storage.jar包,然后导入到了我的当前在...
  • IBM SVC storage

    千次阅读 2015-07-07 20:48:37
    IBM SVC storage 1. Introduction  TheIBM SAN Volume Controller (SVC) is a block storage virtualization appliancethat belongs to the IBM System Storage product family. SVC implements anind

    IBM SVC storage

    1.    Introduction

              TheIBM SAN Volume Controller (SVC) is a block storage virtualization appliancethat belongs to the IBM System Storage product family. SVC implements anindirection [1], or "virtualization", layer in a FibreChannel Storage Area Network (SAN) [2].

    2.   Architecture

              TheIBM 2145 SAN Volume Controller (SVC) is an inline [3] virtualizationor "gateway" device. It logically sits betweenhosts and storage arrays, presenting it to hosts as the storage provider(target) and presenting itself to storage arrays as one big host (initiator). SVCis physically attached to any available port in one or several SAN fabrics. Thevirtualization approach allows for non-disruptive replacements of any part inthe storage infrastructure, including the SVC devicesthemselves. It also aims at simplifying compatibilityrequirements in strongly heterogeneous [4] server and storagelandscapes. All advanced functions are therefore implementedin the virtualization layer, which allows switching storage array vendors [5]without impact. Finally, spreading an SVC installation across two or more sites(stretched clustering) enables basic disaster protection paired with continuousavailability.

    SVCnodes are always clustered, with a minimum of 2 and a maximum of 8 nodes, andlinear scalability. Each I/O group consists of 2nodes. Each node is a 1U high rack-mounted [6] appliance leveragingIBM System x server hardware, protected by redundant power supplies and anintegrated 1U high uninterruptible power supply. Note that the DH8model is a 2U high unit, with integrated battery backup. Anintegrated two-row display and five-button keyboard offer stand-aloneconfiguration and monitoring options. Each node has fourFibre Channel ports and two or four 10/1 Gbit/s Ethernet ports used for FCoE,iSCSI and management. All Fibre Channel & FCoEports on the SVC are both targets and initiators, and are also utilized forinter-cluster communication. This includes maintainingread/write cache integrity, sharing status information, and forwarding [7]reads and writes.

    Writecache is protected by mirroring within a pair of SVC nodes, called I/O group. Virtualizedresources (= storage volumes presented to hosts) are distributed across I/Ogroups to improve performance. Volumes can also be moved nondisruptively between I/O groups, e.g., when new node pairs are added or oldertechnology is removed. Node pairs are always active,meaning both members accept simultaneous writes for each volume. Inaddition, all other cluster nodes accept and forward read and write requestswhich are internally handled by the appropriate I/O group. Path or boardfailures are compensated by non-disruptive failover within each I/O group. Thisrequires multipath drivers such as IBM Subsystem Device Driver (SDD) orstandard MPIO drivers.

    3.   Terminology

    ·        Node- a single 1U or 2U machine.

    SVC node models

    Type-model

    Cache [GB]

    FC speed [Gb/s]

    iSCSI Speed [Gb/s]

    Based upon

    Announced

    2145-4F2

    4

    2

    n/a

    x335

    2-Jun-03

    2145-8F2

    8

    2

    1

    x336

    25-Oct-05

    2145-8F4

    8

    4

    1

    x336

    23-May-06

    2145-8G4

    8

    4

    1

    x3550

    22-May-07

    2145-8A4

    8

    4

    1

    x3250M2

    28-Oct-08

    2145-CF8

    24

    8

    1

    x3550M2

    20-Oct-09

    2145-CG8

    24

    8

    1(10Gbit/soptional)

    x3550M3

    9-May-11

    2145-DH8

    32

    8 & 16

    1 (10 Gbit/soptional)

    x3650M4

    6-May-14

    ·  I/Ogroup - a pair of nodes that duplicate each other's write commands

    ·  Cluster- a group of 1 to 4 I/O groups managed as a single entity.

    ·  Stretchedcluster - a site protection configuration with 1 to 4 I/O groups, eachstretched across two sites, plus a witness site

    ·  ClusterIP address - a single IP address of a cluster that provides administrativeinterfaces via (SSH and HTTPS)

    ·  ServiceIP address - an IP address used to service an individual node. Each node canhave a service IP configured.

    ·  Configurationnode - a single node that holds the cluster's configuration and has theassigned cluster IP address.

    ·  MasterConsole (or SSPC) - a management GUI for SVC until rel 5.1, based on WebSphereApplication Server; not installed on any SVC node, but on a separate machine

    ·  Asof SVC rel 6.1, a Master Console (SSPC) is no longer used. Web basedadministration is done directly on the configuration node, using a HTML5 GUI.

    ·  VirtualDisk (VDisk) - a unit of storage presented to the host. The release 6 GUIrefers to a VDisk as a Volume.

    ·  ManagedDisk (MDisk) - a unit of storage (a LUN) from a real, external disk array,virtualized by the SVC. An MDisk is the base to create an image mode VDisk.

    ·  ManagedDisk Group - (MDisk Group) a group of one or more Mdisks. The extents of theMDisks in an MDisk Group are the base to create a striped or sequential modeVDisk. The release 6 GUI refers to a Managed Disk Group as a Pool.

    ·  Extent- a discrete unit of storage; an MDisk is divided into extents; a VDisk isformed from set of extents.

    4.   Performance

    Release4.3 of the SVC held the Storage Performance Council (SPC) worldrecord for SPC-1 performance benchmarks, returning nearly 275K(274,997.58) IOPS.There was no faster storage subsystem benchmarked by the SPC at that time(October 2008).[2] The SPC-2 benchmarkalso returned a world leading measurement of over 7 GB/s throughput.

    Release5.1 achieved new records with a 4 node and 6 node cluster benchmark with DS8700as backed storage device. SVC broke its own record of 274,997.58 SPC-1 IOPS inMarch 2010, with 315,043.59 for the 4 node cluster and 380,489.30 with the 6node cluster, records that stood until October 2011.

    Release6.2 of the SVC held the Storage Performance Council (SPC) worldrecord for SPC-1 performance benchmarks, returning over 500K (520,043.99) IOPS(I/Os per second) using 8 SVC nodes and Storwize V7000 as the backend disk.There was no faster storage subsystem benchmarked by the SPC at that time(January 2012).[3] The full results andexecutive summaries can be reviewed at the SPC website referenced above.[note 2]

    Release7.x provides multiple enhancements including support for additional CPUs, cacheand adapters. The streamlined cache operates at 100µs fall-through latency[4] and 60 µs cache-hitlatency, enabling SVC as a front-end to IBM FlashSystem solid-state storagewithout significant performance penalty

    5.   IncludedFeatures

    1) Indirection or mapping from virtualLUN to physical LUN

    Serversaccess SVC as if it were a storage controller. The SCSI LUNs they see representvirtual disks (volumes) allocated in SVC from a pool of storage made up fromone or more managed disks (MDisks). A managed disk is simply a storage LUNprovided by one of the storage controllers that SVC is virtualizing. The virtualcapacity can be larger than the managed physical capacity, with a currentmaximum of 32 PB, depending on management granularity (extent size)

    2)Data migration and pooling

    SVCcan move volumes from one capacity pool (MDisk group) to another whilstmaintaining I/O access to the data. Write and read caching remain active. Poolscan be shrunk or expanded by removing or adding hardware capacity, whilemaintaining I/O access to the data. Both features can be used for seamlesshardware migration. Migration from an old SVC model to the most recent model isalso seamless and implies no copying of data.

    3)Importing and exporting existing LUNsvia Image Mode

    "Imagemode" is a non-virtualized pass-through representation of an MDisk(managed LUN) that contains existing client data; such an MDisk can beseamlessly imported into or removed from an SVC cluster.

    4)Fast-write cache

    Writesfrom hosts are acknowledged once they have been committed into the SVC mirroredcache, but prior to being destaged to the underlying storage controllers. Datais protected by replication to the peer node in an I/O group (cluster nodepair). Cache size is dependent on the SVC hardware model and installed options.Fast-write cache is especially useful to increase performance in midrangestorage configurations.

    5)Auto tiering (Easy Tier)

    SVCautomatically selects the best storage hardware for each chunk of data,according to its access patterns. Cache unfriendly "hot" data isdynamically moved to solid state drives SSD, whereas cache friendly"hot" and any "cold" data is moved to economic spinningdisks. Easy Tier also monitors spindle-only workloads.

    6)Solid state drive (SSD) capability

    SVCcan use any supported external SSD storage device or provide its own internalSSD slots, up to 32 per cluster. Easy Tiering is automatically active whenmixing different media in hybrid capacity pools (Managed Diskgroups).

    7)Thin Provisioning

    LUNcapacity is only used when new data is written to a LUN. Data blocks equal zeroare not physically allocated, unless previous data unequal zero exists. Duringimport or during internal migrations, data blocks equal zero are discarded(Thick-to-thin migration).

    Besides,thin provisioning is integrated in the Flash Copy features detailed below toprovide space-efficient snapshots

    8)Virtual Disk Mirroring

    Providesthe ability to maintain two redundant copies of a LUN, implicitly on differentstorage controllers

    9)Site protection with StretchedCluster

    Ageographically distributed, highly available clustered storage setup leveragingthe virtual disk mirroring feature across datacenters within 300 km distance.Stretched Clusters can span 2, 3 or 4 datacenters (chain or ring topology, a4-site cluster requiring 8 cluster nodes). Cluster consistency is ensured by amajority voting set.

    Fromtwo storage devices in two datacenters, SVC presents one common logicalinstance. All application-oriented operations, like Snapshots or Resizing, areapplied on the logical instance. Hardware-oriented operations like real-timecompression or live migration are applied at the physical instance level.

    Unlikein classical mirroring, logical LUNs are readable and writable on both sides(tandem) at the same time, removing the need for "failover","role switch", or "site switch". The feature can becombined with Live PartitionMobility or VMotion to avoid any datatransport during a metro-distance virtual server motion.

    AllSVC cluster nodes also have read/write access to storage hardware in the mirrorlocation, removing the need for site-resynchronization in case of a simple nodefailure.

    10)Enhanced Stretched Cluster

    Afunctionality optimizing data paths within a metro- or geo-distance StretchedCluster (see above), helpful when bandwidth between sites is scarce andcross-site traffic must be minimized. SVC will attempt to use the shortest pathfor reads and writes. For instance, cache write destaging to storage devices isalways performed by the most nearby cache copy, unless its peer cache copy isdown.

    11) Stretched Cluster with Golden Copy(3-site DR)

    AStretched Cluster that maintains an additional synchronous or asynchronous datacopy on an independent Stretched Cluster or SVC or Storwize device at geodistances. The Golden Copy is a disaster protection againstmetro-scale outages impacting the Stretched Cluster as a whole. It leveragesthe optional Metro or Global Mirror functionality.

    ·  Optional features

    1)    Real-Time Compression

    Thistechnology, invented by the acquired startup Storwize,[5] has been integrated inthe SVC and other IBM storage systems. Originally implemented asreal-time filecompression, it has since been enhanced to also providein-flight block compression. The efficiency is equal to"zip" LZW (Lempel–Ziv–Welch) with a verylarge dictionary. The temporal locality of the algorithm mayalso increase the read/write performance on adequate data patternssuch as uncompressed databases stored on spinning disks.

    Real-timecompression can be combined with Easy Tiering, Thin Provisioning and VirtualDisk Mirroring.

    2)   FlashCopy (Snapshot)

    Thisis used to create a disk snapshot for backup, orapplication testing of a single volume. Snapshots require only the"delta" capacity unless created with full-provisioned target volumes.FlashCopy comes in three flavours: Snapshot, Clone, Backup volume. All arebased on optimized copy-on-write technology, and may ormay not remain linked to their source volume.

    Onesource volume can have up to 256 simultaneous targets. Targets can be madeincremental, and cascaded tree like dependency structures can be constructed.Targets can be re-applied to their source or any other appropriate volume, alsoof different size (e.g. resetting any changes from a resize command).

    Copy-on-writeis based on a bitmap with aconfigurable grain size, as opposed to a journal

    3)   Metro Mirror - synchronousremote replication

    Thisallows a remote disaster recovery site at a distance ofup to about 300km

    4)   Global Mirror - asynchronousremote replication

    Thisallows a remote disaster recovery site at a distance of thousands ofkilometres. Each Global Mirror relationship can be configured for high latency/ low bandwidth or for high latency / high bandwidth connectivity, the latterallowing a consistent recovery point objective RPO below 1 sec.

    5)   Global Mirror over IP -remote replication over the Internet

    uses SANslide technology integrated into the SVC firmware to send mirroring datatraffic across a TCP/IP link, while maximizing the bandwidth efficiency of thatlink. This may result in a 100x data transfer acceleration over long distances.

    6.   Appendix

    1)  Word Transaction

    Index

    Word

    Transaction

    1

    Indirection

    间接寻址

    2

    Fibre Channel Storage Area Network

    光纤通道存储区域网络

    3

    inline

    内嵌

    4

    heterogeneous

    异构

    5

    vendors

    供应商

    6

    rack-mounted

    机架安装

    7

    forwarding

    转发

    2)   Concept

    ·     IBMSystem x

    ·     DH8model

    3)  Relatedlink

    IBMStorage virtualization

    http://www-03.ibm.com/systems/storage/virtualization/index.html

     

     

     

    展开全文
  • SLAM Mesh storage processing

    万次阅读 2019-12-14 12:37:40
    Mesh storage processing Project Language License 3DTK C++ GPLv3 CGAL C++ Module dependent GPL/LGPL InstantMesh Mesh Simplification C++ BSD License GEOGRAM C++ Revised BSD License libig...

    Mesh storage processing

    Project Language License
    3DTK C++ GPLv3
    CGAL C++ Module dependent GPL/LGPL
    InstantMesh Mesh Simplification C++ BSD License
    GEOGRAM C++ Revised BSD License
    libigl C++ MPL2
    Mesh-processing-library C++ MIT License
    Open3D C++ MIT License
    OpenMesh C++ BSD 3 clause license
    PCL C++ 3-clause BSD license
    VCG C++ GPL
    展开全文
  • storage.conf的配置中,tracker_server的参数配置的是外网,具体参数为183.62.##.##:23000,但是在centos里面做 测试上传的时候,却出现一下错误: tracker_query_storage_store_list_without_group: server 1. ...
  • IBM System Storage DS Storage Manager 安装和支持指南
  • 这次合入把sockaddr__storage结构中的__ss_align和__ss_padding交换了位置。 这样会导致以前常用的下列类型强转的用法出现问题:_ ``` struct sockaddr_storage prefix_addr (struct sockaddr_in6 *)&(prefix_...
  • Azure Storage 是微软 Azure 云提供的云端存储解决方案,当前支持的存储类型有 Blob、Queue、File 和 Table。笔者在《Azure Blob Storage 基本用法》中介绍了 Blob Storage 的基本用法,本文将介绍 File Storage 的...
  • Azure Storage 是微软 Azure 云提供的云端存储解决方案,当前支持的存储类型有 Blob、Queue、File 和 Table。笔者在前文中介绍了Table Storage 的基本用法,本文将通过C# 代码介绍Blob Storage的主要使用方法。
  • ure Storage 是微软 Azure 云提供的云端存储解决方案,当前支持的存储类型有 Blob、Queue、File 和 Table。笔者在《Azure File Storage 基本用法》中介绍了 File Storage 的基本用法,本文将介绍 Queue Storage 的...
  • Slurm Accounting Storage 配置

    千次阅读 2016-09-15 19:35:39
    Slurm Accounting Storage 配置Slurm中默认是没有配置accounting的功能的,因此如果需要手动配置打开此功能。首先,修改/etc/slurm/slurm.conf文件,这里使用文件来存储# Acct AccountingStorageEnforce=1 ...
  • Intel(R) Matrix Storage Console(中文版)

    热门讨论 2012-05-16 08:47:33
    您可以从以下两种模式检视 Intel(R) Matrix Storage Console:「基本模式」和「进阶模式」。「基本模式」是一种简单的模式,以状态讯息和图示的形式显示装置资讯。在异常的情况下,例如硬碟遗失或硬碟发生故障时,「...
  • Web Storage

    千次阅读 2016-10-09 09:52:58
    Web Storage 分为本地存储和会话存储,不能跨域访问。 Web Storage 使在不影响网站性能的情况下存储大量数据成为可能。 注意:Web Storage 存储的是字符串,获取和存储时别忘了用 JSON.stringify() 和 JSON.parse...
  • 我在SQlyog中执行sql语句产生的错误!... 查找了原因,是因为innodb没配置!!!!... 需要在my.ini里修改, 我的my.ini内容如下:[mysql] ...default-storage-engine=INNODB 没有检查出问题。。所以求大佬赐教
  • 首先扯点别的:今天不上班,在家里和剑宗喝了点酒,和同学聊了会天,也是挺开心,现在学会习。以前调用系统相机拍照的时候,流程是这样的 private void takePhoto() { Intent takePictureIntent = new Intent...
  • FastDFS Storage配置详解

    千次阅读 2016-11-29 11:25:54
    基本配置disabled#func:该配置文件是否生效 #valu: ## true:无效 ## false:生效 ...group_name=group1bind_addr#func:绑定本storage server的IP bind_addr=client_bind#func:bind_addr是针对s
  • docker storage driver compare

    千次阅读 2016-02-19 14:37:55
    docker storage driver对比aufs分为多层镜像层,一个读写层. 修改存在的文件,有写延迟,需要拷贝整个文件到读写层 读文件性能差,需要在多层中搜索 删除一个文件,只需要在读写层放一个空白文件,镜像层文件不删除 性能 ...
  • android Internal storage 和External storage

    千次阅读 2015-07-29 14:54:20
    android Internal storage 和External storage: android 删除文件 保存到Internal Storage --->保密性文件的位置
  • External Storage
  • mass storage

    千次阅读 2012-07-09 21:15:25
    最近在查找数据拷贝的... 在android的USB驱动相关的部分中,目前接触最多的是android.c文件,因为这个文件和f_mass_storage.c以及f_adb.c共同构成了g_android.ko。  讲到这里不得不提的两个英文简称是FSG和LUNs。
  • storage存储

    2019-04-12 18:15:20
    storage只在本地,不参与网络传输,存储的都是字符串 localstorage/seesionstorage 存储/取出数据: localstorage.name = "tanjw"//可以利用json的方法将对象转为字符串,方便存取使用。 localstorage.name //就...
  • web Storage

    2018-08-30 15:17:01
    HTML提供了一种新的对象...实际上我们将数据以键值对的形式保存到Storage对象里,通过Storage对象提供的方法进行数据操作。 增 Storage.setItem() 该方法接受一个键名和值作为参数,将会把键值对添加到存储...
  • storage事件

    2018-03-16 15:06:56
    storage事件:当存储的storage数据发生变化时都会触发它,但是它不同于click类的事件会冒泡和能取消,storage改变的时候,触发这个事件会调用所有同域下其他窗口的storage事件,不过它本身触发storage即当前窗口是...
  • MongoDB Storage

    千次阅读 2016-09-12 10:07:55
    原文链接 On this page ...Storage Engine ... you mix storage engines in a replica set?WiredTiger Storage EngineMMAPv1 Storage EngineCan I manually pad documents to prevent moves
  • Storage Metrics

    千次阅读 2015-05-18 17:05:18
    SharePoint站点在使用过程中,内容会越来越过,这会导致占用内容数据库,也会增加管理的复杂度,甚至会降低系统的响应时间。可以通过设定site quota来...而SharePoint提供的Storage Metrics 功能对管理员就很有帮助了。
  • Storage Options

    千次阅读 2015-04-01 09:49:01
    Android provides several options for you to save persistent application data. The solution you choose depends on your specific needs, such as whether the data should be private to your application or

空空如也

1 2 3 4 5 ... 20
收藏数 84,890
精华内容 33,956
关键字:

storage