精华内容
下载资源
问答
  • more Effective c++

    2019-03-08 17:14:52
    more Effective c++ 看过Essential这本书的可以看这本
  • more effective c++ 中文版 pdf 资源来自网络 分享给各位学习c++
  • learn more study less 英文原版书籍 尝试改变已有学习方式
  • More Effective C++ 简体中文版(pdf 版).pdf
  • highcharts-more.js gauge

    2017-09-27 15:29:50
    highcharts-more.js 文件 可用于制作仪表盘等 highcharts-more.js 文件 可用于制作仪表盘等 highcharts-more.js 文件 可用于制作仪表盘等 highcharts-more.js 文件 可用于制作仪表盘等
  • more effective C++,作者为Scott Meyers,候捷译。绝对高清pdf,非扫描版,可直接用来打印!
  • More Effective C#中文版.pdf 个人收集电子书,仅用学习使用,不可用于商业用途,如有版权问题,请联系删除!
  • 一本关于整体性学习的书籍,英文原版 自制完整书签(非常详细的书签,书签层次完整),方便看整体知识的结构 建议里面实践mind challenge直到成为习惯,否则不能发挥威力。
  • 点击加载跟多
  • Learn More Study Less中文版,提高个人学习效率
  • 【Linux】 日志查看 more 命令

    千次阅读 2020-08-10 10:07:31
    more命令是一个基于vi编辑器文本过滤器,它以全屏幕的方式按页显示文本文件的内容,支持vi中的关键字定位操作。more名单中内置了若干快捷键,常用的有H(获得帮助信息),Enter(向下翻滚一行),空格(向下滚动一屏...

    more命令是一个基于vi编辑器文本过滤器,它以全屏幕的方式按页显示文本文件的内容,支持vi中的关键字定位操作。more名单中内置了若干快捷键,常用的有H(获得帮助信息),Enter(向下翻滚一行),空格(向下滚动一屏),Q(退出命令)。more命令从前向后读取文件,因此在启动时就加载整个文件。

    该命令一次显示一屏文本,满屏后停下来,并且在屏幕的底部出现一个提示信息,给出至今己显示的该文件的百分比:–More–(XX%)可以用下列不同的方法对提示做出回答:

    1. 按Space键:显示文本的下一屏内容;
    2. 按Enier键:只显示文本的下一行内容;
    3. 按斜线符|:接着输入一个模式,可以在文本中寻找下一个相匹配的模式;
    4. 按H键:显示帮助屏,该屏上有相关的帮助信息;
    5. 按B键:显示上一屏内容;
    6. 按Q键:退出more命令。
    NAME(名称)
           more - file perusal filter for crt viewing
    			  文件过滤器
    
    SYNOPSIS(概要,大纲)
           more [options] file [...]
    
    DESCRIPTION(描述)
           more  is  a filter for paging through text one screenful at a time.  
    	   This version is especially primitive.  
    	   Users should realize that less(1) provides more(1) emulation plus extensive enhancements.
    	   more 命令以全屏幕的方式按页显示文本文件的内容。
    	   这个版本特别原始。
    	   用户应该了解 less 命令提供了比 more 命令更多更强大的功能。
    
    OPTIONS(选项)
           Command-line options are described below.  
    	   Options are also taken from the environment variable MORE (make sure to precede them with a dash (``-''))  
    	   but  command  line options will override them.
    	   命令行选项如下所示。
    	   这些选项也可以从环境变量 MORE 中获得(确保在这些选项前面有“-”)
    	   另外,命令行选项可以覆盖他们。
    
           -number
                  This option specifies an integer number which is the screen size (in lines).
    			  指定每屏显示的行数为 number
    
           -d     more will prompt the user with the message "[Press space to continue, 'q' to quit.]" 
    			  and will display "[Press 'h' for instructions.]" instead of ringing the bell
                  when an illegal key is pressed.
    			  提示使用者,在画面下方显示 [Press space to continue, 'q' to quit.] ,
    			  如果使用者按错键,则会显示 [Press 'h' for instructions.] 而不是 '哔' 声
    
           -l     more usually treats ^L (form feed) as a special character, 
    			  and will pause after any line that contains a form feed.  
    			  The -l option will prevent this behavior.
    			  取消遇见特殊字元 ^L(送纸字元)时会暂停的功能
    
           -f     Causes more to count logical, rather than screen lines (i.e., long lines are not folded).
    			  计算行数时,以实际上的行数,而非自动换行过后的行数(有些单行字数太长的会被扩展为两行或两行以上)
    
           -p     Do not scroll.  Instead, clear the whole screen and then display the text.  
    			  Notice that this option is switched on automatically if the executable is named page.
    			  不以滚动的方式显示每一页,而是先清除萤幕后再显示内容。
    			  注意,如果可执行文件被命名为page,那么这个选项就会自动打开。
    
           -c     Do not scroll.  Instead, paint each screen from the top, clearing the remainder of each line as it is displayed.
    			  跟 -p 相似,不同的是先显示内容再清除其他旧资料
    
           -s     Squeeze multiple blank lines into one.
    			  当遇到有连续两行以上的空白行,就代换为一行的空白行
    
           -u     Suppress underlining.
    			  不显示下划线(根据环境变数 TERM 指定的 terminal 而有所不同)
    
           +/     The +/ option specifies a string that will be searched for before each file is displayed.
    			  在每个文档显示前搜寻该字串(string),然后从该字串之后开始显示
    
           +number
                  Start at line number.
    			  从文件第 number 行开始显示
    
    COMMANDS(命令)
           Interactive commands for more are based on vi(1).  
    	   Some commands may be preceded by a decimal number, called k in the descriptions below.   
    	   In  the  following  descriptions, ^X means control-X.
    	   more 的交互命令是基于 vi 的。
    
                  h or ?    Help: display a summary of these commands.  
    						If you forget all the other commands, remember this one.
    						显示所有命令及功能解释。
    
                  SPACE     Display next k lines of text.  Defaults to current screen size.
    						显示文件接下来的 k 行。默认为当前的屏幕大小。
    
                  z         Display next k lines of text.  Defaults to current screen size.  Argument becomes new default.
    						显示接下来的 k 行。默认为当前的屏幕大小。使用后参数变成默认的。
    
                  RETURN    Display next k lines of text.  Defaults to 1.  Argument becomes new default.
    						显示接下来的 k 行。默认为当前的屏幕大小。使用后参数变成默认的。
    
                  d or ^D   Scroll k lines.  Default is current scroll size, initially 11.  Argument becomes new default.
    						向下滚动 k 行,默认为当前的滚动大小,初始值是11。使用后参数变成默认的。
    
                  q or Q or INTERRUPT
                            Exit.
    						退出
    
                  s         Skip forward k lines of text.  Defaults to 1.
    						跳过 k 行。并向前滚动。默认为 1。
    
                  f         Skip forward k screenfuls of text.  Defaults to 1.
    						跳过 k 个整屏的文本。默认为 1。
    
                  b or ^B   Skip backwards k screenfuls of text.  Defaults to 1.  Only works with files, not pipes.
    						跳过k个大屏幕的文本。默认为1。只处理文件,而不是管道。
    
    			  ´         Go to place where previous search started.
    						跳转到之前搜索开始的地方。
    
                  =         Display current line number.
    						显示当前的行数。
    
                  /pattern  Search for kth occurrence of regular expression.  Defaults to 1.
    						查找正则表达式的第k次出现。默认为1。
    
                  n         Search for kth occurrence of last regular expression.  Defaults to 1.
    						查找正则表达式的倒数第k次出现。默认为1。
    
                  !command or :!command
                            Execute command in a subshell.
    						在子shell中执行命令。
    
                  v         Start  up  an  editor  at  current  line.   
    						The editor is taken from the environment variable VISUAL if defined, 
    						or EDITOR if VISUAL is not defined, or defaults to vi if neither VISUAL nor EDITOR is defined.
    						在当前行启动编辑器。
    						如果定义了环境变量,那么编辑器就会从环境变量中获取,如果没有定义,
    						那么编辑器将被定义为vi,如果没有定义可视化和编辑器,则默认为vi。
    
                  ^L        Redraw screen.
    						屏幕重绘
    
                  :n        Go to kth next file.  Defaults to 1.
    						向前跳转到第K个文件
    
                  :P        Go to kth previous file.  Defaults to 1.
    						向回跳转到第K个文件
    
                  :f        Display current file name and line number.
    						显示当前的文件名称和行号
    
                  .         Repeat previous command.
    						重复上一个命令
    
    ENVIRONMENT(环境)
           More utilizes the following environment variables, if they exist:
    	   如果存在以下环境变量,More将使用以下环境变量:
    
           MORE   This variable may be set with favored options to more.
    			  这个变量可以设置more常用的选项。
    
           SHELL  Current shell in use (normally set by the shell at login time).
    			  当前使用的shell(通常在登录时由shell设置)。
    
           TERM   Specifies terminal type, used by more to get the terminal characteristics necessary to manipulate the screen.
    			  指定终端类型,更多地用于获取操作屏幕所需的终端特征。
    
           VISUAL Editor the user is preferring.  Used when key command v is pressed.
    			  用户更喜欢的编辑器。在按下键命令v时使用。
    
           EDITOR Editor of choise when VISUAL is not specified.
    			  当VISUAL环境变量没有被指定时,使用choise编辑器。
    

    1、逐页显示 test.log 文档内容,如有连续两行以上空白行则以一行空白行显示。

    [root@peipei3514 usr]# more -s test.log
    1 2018-03-02 12:39:06:698 YZXBB
    2 2018-03-03 12:40:16:700 VGLHY
    3 2018-03-04 12:41:17:701 XANRN
    
            4 2018-03-05 12:42:22:701 RXNYJ
    5 2018-03-06 12:43:14:701 BBUEM
    6 2018-03-07 12:44:14:701 FKYDL
    7 2018-03-08 12:45:08:701 KAHMA
    8 2018-03-09 12:46:14:702 GZZXG
    9 2018-03-10 12:47:16:702 OEVDO
    10 2018-03-11 12:48:06:702 ALXQQ
    11 2018-03-12 12:49:10:702 HOCSQ
    --More--(5%)
    

    2、从第 20 行开始显示 testfile 之文档内容。

    [root@peipei3514 usr]# more +20 test2.log
    220 2018-10-07 19:09:36:781 DJAOD
    221 2018-10-08 19:10:31:781 TBYYK
    222 2018-10-09 19:11:30:781 LYYPT
    223 2018-10-10 19:12:37:781 AXVWT
    224 2018-10-11 19:13:33:781 UXSGR
    225 2018-10-12 19:14:34:781 TBMJP
    226 2018-10-13 19:15:33:781 IMNNK
    227 2018-10-14 19:16:23:781 LHEGY
    228 2018-10-15 19:17:37:782 YMZPO
    --More--(14%)
    

    3、从文件中查找第一个出现"ZCJ"字符串的行,并从该处前两行开始显示输出

    [root@peipei3514 usr]# more +/ZCJ test2.log
    
    ...跳过
    203 2018-09-20 18:52:37:779 UZDCE
    204 2018-09-21 18:53:40:779 NCISH
    205 2018-09-22 18:54:34:779 ZCJUY
    206 2018-09-23 18:55:38:779 SEJKZ
    207 2018-09-24 18:56:27:779 CNGMW
    208 2018-09-25 18:57:31:779 GLILU
    209 2018-09-26 18:58:24:779 VWUSO
    210 2018-09-27 18:59:39:779 HDRAT
    211 2018-09-28 19:00:40:779 CFGHE
    212 2018-09-29 19:01:41:780 VHLIB
    213 2018-09-30 19:02:34:780 NMJPE
    214 2018-10-01 19:03:29:780 CJWWI
    215 2018-10-02 19:04:40:780 HISAY
    --More--(7%)
    

    出自: https://blog.csdn.net/liupeifeng3514/article/details/79419880

    展开全文
  • Linux 日志查看 | more 命令

    万次阅读 2018-03-02 10:22:29
    more命令是一个基于vi编辑器文本过滤器,它以全屏幕的方式按页显示文本文件的内容,支持vi中的关键字定位操作。more名单中内置了若干快捷键,常用的有H(获得帮助信息),Enter(向下翻滚一行),空格(向下滚动一屏...

    more命令是一个基于vi编辑器文本过滤器,它以全屏幕的方式按页显示文本文件的内容,支持vi中的关键字定位操作。more名单中内置了若干快捷键,常用的有H(获得帮助信息),Enter(向下翻滚一行),空格(向下滚动一屏),Q(退出命令)。more命令从前向后读取文件,因此在启动时就加载整个文件。

    该命令一次显示一屏文本,满屏后停下来,并且在屏幕的底部出现一个提示信息,给出至今己显示的该文件的百分比:–More–(XX%)可以用下列不同的方法对提示做出回答:

    1. 按Space键:显示文本的下一屏内容;
    2. 按Enier键:只显示文本的下一行内容;
    3. 按斜线符|:接着输入一个模式,可以在文本中寻找下一个相匹配的模式;
    4. 按H键:显示帮助屏,该屏上有相关的帮助信息;
    5. 按B键:显示上一屏内容;
    6. 按Q键:退出more命令。
    NAME(名称)
           more - file perusal filter for crt viewing
    			  文件过滤器
    
    SYNOPSIS(概要,大纲)
           more [options] file [...]
    
    DESCRIPTION(描述)
           more  is  a filter for paging through text one screenful at a time.  
    	   This version is especially primitive.  
    	   Users should realize that less(1) provides more(1) emulation plus extensive enhancements.
    	   more 命令以全屏幕的方式按页显示文本文件的内容。
    	   这个版本特别原始。
    	   用户应该了解 less 命令提供了比 more 命令更多更强大的功能。
    
    OPTIONS(选项)
           Command-line options are described below.  
    	   Options are also taken from the environment variable MORE (make sure to precede them with a dash (``-''))  
    	   but  command  line options will override them.
    	   命令行选项如下所示。
    	   这些选项也可以从环境变量 MORE 中获得(确保在这些选项前面有“-”)
    	   另外,命令行选项可以覆盖他们。
    
           -number
                  This option specifies an integer number which is the screen size (in lines).
    			  指定每屏显示的行数为 number
    
           -d     more will prompt the user with the message "[Press space to continue, 'q' to quit.]" 
    			  and will display "[Press 'h' for instructions.]" instead of ringing the bell
                  when an illegal key is pressed.
    			  提示使用者,在画面下方显示 [Press space to continue, 'q' to quit.] ,
    			  如果使用者按错键,则会显示 [Press 'h' for instructions.] 而不是 '哔' 声
    
           -l     more usually treats ^L (form feed) as a special character, 
    			  and will pause after any line that contains a form feed.  
    			  The -l option will prevent this behavior.
    			  取消遇见特殊字元 ^L(送纸字元)时会暂停的功能
    
           -f     Causes more to count logical, rather than screen lines (i.e., long lines are not folded).
    			  计算行数时,以实际上的行数,而非自动换行过后的行数(有些单行字数太长的会被扩展为两行或两行以上)
    
           -p     Do not scroll.  Instead, clear the whole screen and then display the text.  
    			  Notice that this option is switched on automatically if the executable is named page.
    			  不以滚动的方式显示每一页,而是先清除萤幕后再显示内容。
    			  注意,如果可执行文件被命名为page,那么这个选项就会自动打开。
    
           -c     Do not scroll.  Instead, paint each screen from the top, clearing the remainder of each line as it is displayed.
    			  跟 -p 相似,不同的是先显示内容再清除其他旧资料
    
           -s     Squeeze multiple blank lines into one.
    			  当遇到有连续两行以上的空白行,就代换为一行的空白行
    
           -u     Suppress underlining.
    			  不显示下划线(根据环境变数 TERM 指定的 terminal 而有所不同)
    
           +/     The +/ option specifies a string that will be searched for before each file is displayed.
    			  在每个文档显示前搜寻该字串(string),然后从该字串之后开始显示
    
           +number
                  Start at line number.
    			  从文件第 number 行开始显示
    
    COMMANDS(命令)
           Interactive commands for more are based on vi(1).  
    	   Some commands may be preceded by a decimal number, called k in the descriptions below.   
    	   In  the  following  descriptions, ^X means control-X.
    	   more 的交互命令是基于 vi 的。
    
                  h or ?    Help: display a summary of these commands.  
    						If you forget all the other commands, remember this one.
    						显示所有命令及功能解释。
    
                  SPACE     Display next k lines of text.  Defaults to current screen size.
    						显示文件接下来的 k 行。默认为当前的屏幕大小。
    
                  z         Display next k lines of text.  Defaults to current screen size.  Argument becomes new default.
    						显示接下来的 k 行。默认为当前的屏幕大小。使用后参数变成默认的。
    
                  RETURN    Display next k lines of text.  Defaults to 1.  Argument becomes new default.
    						显示接下来的 k 行。默认为当前的屏幕大小。使用后参数变成默认的。
    
                  d or ^D   Scroll k lines.  Default is current scroll size, initially 11.  Argument becomes new default.
    						向下滚动 k 行,默认为当前的滚动大小,初始值是11。使用后参数变成默认的。
    
                  q or Q or INTERRUPT
                            Exit.
    						退出
    
                  s         Skip forward k lines of text.  Defaults to 1.
    						跳过 k 行。并向前滚动。默认为 1。
    
                  f         Skip forward k screenfuls of text.  Defaults to 1.
    						跳过 k 个整屏的文本。默认为 1。
    
                  b or ^B   Skip backwards k screenfuls of text.  Defaults to 1.  Only works with files, not pipes.
    						跳过k个大屏幕的文本。默认为1。只处理文件,而不是管道。
    
    			  ´         Go to place where previous search started.
    						跳转到之前搜索开始的地方。
    
                  =         Display current line number.
    						显示当前的行数。
    
                  /pattern  Search for kth occurrence of regular expression.  Defaults to 1.
    						查找正则表达式的第k次出现。默认为1。
    
                  n         Search for kth occurrence of last regular expression.  Defaults to 1.
    						查找正则表达式的倒数第k次出现。默认为1。
    
                  !command or :!command
                            Execute command in a subshell.
    						在子shell中执行命令。
    
                  v         Start  up  an  editor  at  current  line.   
    						The editor is taken from the environment variable VISUAL if defined, 
    						or EDITOR if VISUAL is not defined, or defaults to vi if neither VISUAL nor EDITOR is defined.
    						在当前行启动编辑器。
    						如果定义了环境变量,那么编辑器就会从环境变量中获取,如果没有定义,
    						那么编辑器将被定义为vi,如果没有定义可视化和编辑器,则默认为vi。
    
                  ^L        Redraw screen.
    						屏幕重绘
    
                  :n        Go to kth next file.  Defaults to 1.
    						向前跳转到第K个文件
    
                  :P        Go to kth previous file.  Defaults to 1.
    						向回跳转到第K个文件
    
                  :f        Display current file name and line number.
    						显示当前的文件名称和行号
    
                  .         Repeat previous command.
    						重复上一个命令
    
    ENVIRONMENT(环境)
           More utilizes the following environment variables, if they exist:
    	   如果存在以下环境变量,More将使用以下环境变量:
    
           MORE   This variable may be set with favored options to more.
    			  这个变量可以设置more常用的选项。
    
           SHELL  Current shell in use (normally set by the shell at login time).
    			  当前使用的shell(通常在登录时由shell设置)。
    
           TERM   Specifies terminal type, used by more to get the terminal characteristics necessary to manipulate the screen.
    			  指定终端类型,更多地用于获取操作屏幕所需的终端特征。
    
           VISUAL Editor the user is preferring.  Used when key command v is pressed.
    			  用户更喜欢的编辑器。在按下键命令v时使用。
    
           EDITOR Editor of choise when VISUAL is not specified.
    			  当VISUAL环境变量没有被指定时,使用choise编辑器。
    

    1、逐页显示 test.log 文档内容,如有连续两行以上空白行则以一行空白行显示。

    [root@peipei3514 usr]# more -s test.log
    1 2018-03-02 12:39:06:698 YZXBB
    2 2018-03-03 12:40:16:700 VGLHY
    3 2018-03-04 12:41:17:701 XANRN
    
            4 2018-03-05 12:42:22:701 RXNYJ
    5 2018-03-06 12:43:14:701 BBUEM
    6 2018-03-07 12:44:14:701 FKYDL
    7 2018-03-08 12:45:08:701 KAHMA
    8 2018-03-09 12:46:14:702 GZZXG
    9 2018-03-10 12:47:16:702 OEVDO
    10 2018-03-11 12:48:06:702 ALXQQ
    11 2018-03-12 12:49:10:702 HOCSQ
    --More--(5%)
    

    2、从第 20 行开始显示 testfile 之文档内容。

    [root@peipei3514 usr]# more +20 test2.log
    220 2018-10-07 19:09:36:781 DJAOD
    221 2018-10-08 19:10:31:781 TBYYK
    222 2018-10-09 19:11:30:781 LYYPT
    223 2018-10-10 19:12:37:781 AXVWT
    224 2018-10-11 19:13:33:781 UXSGR
    225 2018-10-12 19:14:34:781 TBMJP
    226 2018-10-13 19:15:33:781 IMNNK
    227 2018-10-14 19:16:23:781 LHEGY
    228 2018-10-15 19:17:37:782 YMZPO
    --More--(14%)
    

    3、从文件中查找第一个出现"ZCJ"字符串的行,并从该处前两行开始显示输出

    [root@peipei3514 usr]# more +/ZCJ test2.log
    
    ...跳过
    203 2018-09-20 18:52:37:779 UZDCE
    204 2018-09-21 18:53:40:779 NCISH
    205 2018-09-22 18:54:34:779 ZCJUY
    206 2018-09-23 18:55:38:779 SEJKZ
    207 2018-09-24 18:56:27:779 CNGMW
    208 2018-09-25 18:57:31:779 GLILU
    209 2018-09-26 18:58:24:779 VWUSO
    210 2018-09-27 18:59:39:779 HDRAT
    211 2018-09-28 19:00:40:779 CFGHE
    212 2018-09-29 19:01:41:780 VHLIB
    213 2018-09-30 19:02:34:780 NMJPE
    214 2018-10-01 19:03:29:780 CJWWI
    215 2018-10-02 19:04:40:780 HISAY
    --More--(7%)
    

    4、设定每屏显示行数

    [root@peipei3514 usr]# more -5 test2.log
    201 2018-09-18 18:50:25:778 ZHWKD
    202 2018-09-19 18:51:26:778 VQGRP
    203 2018-09-20 18:52:37:779 UZDCE
    204 2018-09-21 18:53:40:779 NCISH
    205 2018-09-22 18:54:34:779 ZCJUY
    --More--(2%)
    

    说明:最下面显示了该屏展示的内容占文件总行数的比例,按 Ctrl+F 或者 空格键 将会显示下一屏5条内容,百分比也会跟着变化。

    5、列一个目录下的文件,由于内容太多,我们应该学会用more来分页显示。这得和管道 | 结合起来 。

    [root@peipei3514 usr]# ls -l| more -5
    总用量 116
    dr-xr-xr-x.  2 root root 20480 12月 29 15:20 bin
    drwxr-xr-x.  2 root root     6 11月  5 2016 etc
    drwxr-xr-x.  2 root root     6 11月  5 2016 games
    drwxr-xr-x.  3 root root    23 12月 23 23:12 include
    --More--
    

    6、显示文件接下来的 5 行

    先按数字键5,再按空格键。
    
    展开全文
  • Linux中more和less命令用法

    千次阅读 2018-11-05 16:18:37
    一、more命令 more功能类似 cat ,cat命令是整个文件的内容从上到下显示在屏幕上。 more会以一页一页的显示方便使用者逐页阅读,而最基本的指令就是按空白键(space)就往下一页显示,按 b 键就会往回(back)...

    一、more命令

    more功能类似 cat ,cat命令是整个文件的内容从上到下显示在屏幕上。 more会以一页一页的显示方便使用者逐页阅读,而最基本的指令就是按空白键(space)就往下一页显示,按 b 键就会往回(back)一页显示,而且还有搜寻字串的功能 。more命令从前向后读取文件,因此在启动时就加载整个文件。

    1.命令格式:

    more [-dlfpcsu ] [-num ] [+/ pattern] [+ linenum] [file ... ] 

    2.命令功能:

    more命令和cat的功能一样都是查看文件里的内容,但有所不同的是more可以按页来查看文件的内容,还支持直接跳转行等功能。

    3.命令参数:

    +n      从笫n行开始显示

    -n       定义屏幕大小为n行

    +/pattern 在每个档案显示前搜寻该字串(pattern),然后从该字串前两行之后开始显示  

    -c       从顶部清屏,然后显示

    -d       提示“Press space to continue,’q’ to quit(按空格键继续,按q键退出)”,禁用响铃功能

    -l        忽略Ctrl+l(换页)字符

    -p       通过清除窗口而不是滚屏来对文件进行换页,与-c选项相似

    -s       把连续的多个空行显示为一行

    -u       把文件内容中的下画线去掉

    4.常用操作命令:

    Enter    向下n行,需要定义。默认为1行

    Ctrl+F   向下滚动一屏

    空格键  向下滚动一屏

    Ctrl+B  返回上一屏

    =       输出当前行的行号

    :f     输出文件名和当前行的行号

    V      调用vi编辑器

    !命令   调用Shell,并执行命令 

    q       退出more

    5.命令实例:

    实例1:显示文件中从第3行起的内容

    命令:

    aijian.shi@U-aijian-shi:~/ALM$ cat test.log                   #显示所有日志内容
    aijian.shi@U-aijian-shi:~/ALM$ more +3 test.log               #从第三行开始显示日志内容

    输出:

    复制代码

     1 aijian.shi@U-aijian-shi:~/ALM$ cat test.log
     2 2016-8-1 aijian.shi
     3 2016-8-2 yafang.wei
     4 2016-8-3 hong.zhan
     5 2016-8-4 yuyan.zhang
     6 2016-8-5 senlin.zhao
     7 2016-8-6 yanbin.liu
     8 2016-8-7 hui.liu
     9 2016-8-8 yanhua.liu
    10 2016-8-9 baoixn.cui
    11 2016-8-10 ge.song
    12 2016-8-11 zhongjun.zhen
    13 2016-8-12 qiu.liao
    aijian.shi@U-aijian-shi:~/ALM$ more +3 test.log
    2016-8-3 hong.zhan
    2016-8-4 yuyan.zhang
    2016-8-5 senlin.zhao
    2016-8-6 yanbin.liu
    2016-8-7 hui.liu
    2016-8-8 yanhua.liu
    2016-8-9 baoixn.cui
    2016-8-10 ge.song
    2016-8-11 zhongjun.zhen
    2016-8-12 qiu.lia

    复制代码

    实例2.将日志内容设置为每屏显示4行

    命令:

    aijian.shi@U-aijian-shi:~/ALM$ more -4 test.log

    输出:

    复制代码

     1 aijian.shi@U-aijian-shi:~/ALM$ more -4 test.log
     2 2016-8-1 aijian.shi
     3 2016-8-2 yafang.wei
     4 2016-8-3 hong.zhan
     5 2016-8-4 yuyan.zhang
     6 
     7 ...skipping one line              #这里使用ctrl+F或者空格键来滚屏
     8 2016-8-6 yanbin.liu
     9 2016-8-7 hui.liu
    10 2016-8-8 yanhua.liu
    11 2016-8-9 baoixn.cui
    12 
    13 ...skipping one line
    14 2016-8-11 zhongjun.zhen
    15 2016-8-12 qiu.liao

    复制代码

    实例3.从文件中查找第一个出现"liu"字符串的行,并从该处前两行开始显示输出

    命令:

    aijian.shi@U-aijian-shi:~/ALM$ more +/liu test.log

     

    输出:

    复制代码

     1 aijian.shi@U-aijian-shi:~/ALM$ more +/liu test.log
     2 
     3 ...skipping
     4 2016-8-4 yuyan.zhang
     5 2016-8-5 senlin.zhao
     6 2016-8-6 yanbin.liu
     7 2016-8-7 hui.liu
     8 2016-8-8 yanhua.liu
     9 2016-8-9 baoixn.cui
    10 2016-8-10 ge.song
    11 2016-8-11 zhongjun.zhen
    12 2016-8-12 qiu.liao

    复制代码

    实例4.当一个目录下的文件内容太多,可以用more来分页显示。这得和管道 | 结合起来

    命令:

    aijian.shi@U-aijian-shi:~/ALM$ cat test.log | more -5   #“|”表示管道,作用是可以将前面命令的输出当做后面命令的输入
    

    输出:

    复制代码

     1 aijian.shi@U-aijian-shi:~/ALM$ cat test.log | more -5
     2 2016-8-1 aijian.shi
     3 2016-8-2 yafang.wei
     4 2016-8-3 hong.zhan
     5 2016-8-4 yuyan.zhang
     6 2016-8-5 senlin.zhao
     7 
     8 ...skipping one line
     9 2016-8-7 hui.liu
    10 2016-8-8 yanhua.liu
    11 2016-8-9 baoixn.cui
    12 2016-8-10 ge.song
    13 2016-8-11 zhongjun.zhen
    14 --more--

    复制代码

     

     

    二、less指令

    less 工具也是对文件或其它输出进行分页显示的工具,应该说是linux正统查看文件内容的工具,功能极其强大。less 的用法比起 more 更加的有弹性。 在 more 的时候,我们并没有办法向前面翻, 只能往后面看,但若使用了 less 时,就可以使用 [pageup] [pagedown] 等按 键的功能来往前往后翻看文件,更容易用来查看一个文件的内容!除此之外,在 less 里头可以拥有更多的搜索功能,不止可以向下搜,也可以向上搜。

    1.命令格式:

    less [参数]  文件 

    2.命令功能:

    less 与 more 类似,但使用 less 可以随意浏览文件,而 more 仅能向前移动,却不能向后移动,而且 less 在查看之前不会加载整个文件。

    3.命令参数:

    -b <缓冲区大小> 设置缓冲区的大小

    -e  当文件显示结束后,自动离开

    -f  强迫打开特殊文件,例如外围设备代号、目录和二进制文件

    -g  只标志最后搜索的关键词

    -i  忽略搜索时的大小写

    -m  显示类似more命令的百分比

    -N  显示每行的行号

    -o <文件名> 将less 输出的内容在指定文件中保存起来

    -Q  不使用警告音

    -s  显示连续空行为一行

    -S  行过长时间将超出部分舍弃

    -x <数字> 将“tab”键显示为规定的数字空格

    /字符串:向下搜索“字符串”的功能

    ?字符串:向上搜索“字符串”的功能

    n:重复前一个搜索(与 / 或 ? 有关)

    N:反向重复前一个搜索(与 / 或 ? 有关)

    b  向后翻一页

    d  向后翻半页

    h  显示帮助界面

    Q  退出less 命令

    u  向前滚动半页

    y  向前滚动一行

    空格键 滚动一行

    回车键 滚动一页

    [pagedown]: 向下翻动一页

    [pageup]:   向上翻动一页

    4.使用实例:

    实例1:ps查看进程信息并通过less分页显示同时显示行号

    命令:

    aijian.shi@U-aijian-shi:~/ALM$ ps -ef|less -N

    输出:

    复制代码

     1       1 UID        PID  PPID  C STIME TTY          TIME CMD
     2       2 root         1     0  0 Aug08 ?        00:00:00 /sbin/init
     3       3 root         2     0  0 Aug08 ?        00:00:00 [kthreadd]
     4       4 root         3     2  0 Aug08 ?        00:00:02 [ksoftirqd/0]
     5       5 root         6     2  0 Aug08 ?        00:00:00 [migration/0]
     6       6 root         7     2  0 Aug08 ?        00:00:00 [watchdog/0]
     7       7 root         8     2  0 Aug08 ?        00:00:00 [migration/1]
     8       8 root         9     2  0 Aug08 ?        00:00:00 [kworker/1:0]
     9       9 root        10     2  0 Aug08 ?        00:00:01 [ksoftirqd/1]
    10      10 root        11     2  0 Aug08 ?        00:00:00 [watchdog/1]
    11      11 root        12     2  0 Aug08 ?        00:00:00 [migration/2]
    12      12 root        14     2  0 Aug08 ?        00:00:01 [ksoftirqd/2]
    13      13 root        15     2  0 Aug08 ?        00:00:00 [watchdog/2]
    14      14 root        16     2  0 Aug08 ?        00:00:00 [migration/3]
    15      15 root        18     2  0 Aug08 ?        00:00:01 [ksoftirqd/3]
    16      16 root        19     2  0 Aug08 ?        00:00:00 [watchdog/3]
    17      17 root        20     2  0 Aug08 ?        00:00:00 [migration/4]
    18      18 root        22     2  0 Aug08 ?        00:00:00 [ksoftirqd/4]
    19      19 root        23     2  0 Aug08 ?        00:00:00 [watchdog/4]
    20      20 root        24     2  0 Aug08 ?        00:00:00 [migration/5]
    21      21 root        26     2  0 Aug08 ?        00:00:00 [ksoftirqd/5]
    22      22 root        27     2  0 Aug08 ?        00:00:00 [watchdog/5]
    23      23 root        28     2  0 Aug08 ?        00:00:00 [migration/6]
    24 :

    复制代码

    实例2.浏览多个文件

    命令:

    aijian.shi@U-aijian-shi:~/ALM$ less test2.log test.log

    输出:

    复制代码

     1     1  ifconfig
     2     2  ping www.baidu.com
     3     3  ifconfig
     4     4  //10.128.161.108/share
     5     5  10.128.161.108/share
     6     6  ssh
     7     7  keygen
     8     8  trsa
     9     9  ssh
    10    10  .ssh/
    11 
    12 
    13  test2.log (file 1 of 2) (END) - Next: test.log

    复制代码

    说明:

    输入 :n后,切换到 test.log

    输入 :p 后,切换到test2.log

    ps:当正在浏览一个文件时,也可以使用 :e命令 打开另一个文件。

    命令:

    less file1
    
    :e file2

     

    5.附加备注

    1.全屏导航

    ctrl + F - 向前移动一屏

    ctrl + B - 向后移动一屏

    ctrl + D - 向前移动半屏

    ctrl + U - 向后移动半屏

     

    2.单行导航

    j - 向前移动一行

    k - 向后移动一行

     

    3.其它导航

    G - 移动到最后一行

    g - 移动到第一行

    q / ZZ - 退出 less 命令

     

    4.其它有用的命令

    v - 使用配置的编辑器编辑当前文件

    h - 显示 less 的帮助文档

    &pattern - 仅显示匹配模式的行,而不是整个文件

     

    5.标记导航

    当使用 less 查看大文件时,可以在任何一个位置作标记,可以通过命令导航到标有特定标记的文本位置:

    ma - 使用 a 标记文本的当前位置

    'a - 导航到标记 a 处

     

    6.查找

    more, less 都具备查找功能,按/ 然后输入要找的字串,再按 Enter 即可,按 n(next) 会继续找,大写的 N 则是往回(上)找,按 q(quit)或者ZZ离开

    展开全文
  • spark No more replicas available for rdd异常

    千次阅读 2018-04-17 17:52:02
    运行一个客户端模式spark程序出现No more replicas available for rdd异常,如下: 18-04-16 18:01:53,750 INFO [dag-scheduler-event-loop] o.a.s.s.DAGScheduler [Logging.scala:54] Resubmitted ...

    运行一个客户端模式spark程序出现No more replicas available for rdd异常,如下:

    18-04-16 18:01:53,750 INFO [dag-scheduler-event-loop] o.a.s.s.DAGScheduler [Logging.scala:54] Resubmitted ShuffleMapTask(11, 507), so marking it as still running
    2018-04-16 18:01:53,750 INFO [dag-scheduler-event-loop] o.a.s.s.DAGScheduler [Logging.scala:54] Resubmitted ShuffleMapTask(11, 594), so marking it as still running
    2018-04-16 18:01:53,750 INFO [dag-scheduler-event-loop] o.a.s.s.DAGScheduler [Logging.scala:54] Resubmitted ShuffleMapTask(11, 406), so marking it as still running
    2018-04-16 18:01:53,750 INFO [dag-scheduler-event-loop] o.a.s.s.DAGScheduler [Logging.scala:54] Resubmitted ShuffleMapTask(11, 525), so marking it as still running
    2018-04-16 18:01:53,750 INFO [dag-scheduler-event-loop] o.a.s.s.DAGScheduler [Logging.scala:54] Resubmitted ShuffleMapTask(11, 43), so marking it as still running
    2018-04-16 18:01:53,750 INFO [dag-scheduler-event-loop] o.a.s.s.DAGScheduler [Logging.scala:54] Executor lost: 34 (epoch 34)
    2018-04-16 18:01:53,750 INFO [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:54] Trying to remove executor 34 from BlockManagerMaster.
    2018-04-16 18:01:53,751 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_180 !
    2018-04-16 18:01:53,751 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_183 !
    2018-04-16 18:01:53,751 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_184 !
    2018-04-16 18:01:53,751 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_181 !
    2018-04-16 18:01:53,751 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_182 !
    2018-04-16 18:01:53,751 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_188 !
    2018-04-16 18:01:53,751 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_185 !
    2018-04-16 18:01:53,751 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_186 !
    2018-04-16 18:01:53,752 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_178 !
    2018-04-16 18:01:53,752 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_299 !
    2018-04-16 18:01:53,752 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_179 !
    2018-04-16 18:01:53,752 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_194 !
    2018-04-16 18:01:53,752 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_195 !
    2018-04-16 18:01:53,752 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_192 !
    2018-04-16 18:01:53,752 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_193 !
    2018-04-16 18:01:53,752 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_198 !
    2018-04-16 18:01:53,752 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_199 !
    2018-04-16 18:01:53,752 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_196 !
    2018-04-16 18:01:53,753 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_189 !
    2018-04-16 18:01:53,753 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_53 !
    2018-04-16 18:01:53,753 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_54 !
    2018-04-16 18:01:53,753 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_55 !
    2018-04-16 18:01:53,753 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_56 !
    2018-04-16 18:01:53,753 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_57 !
    2018-04-16 18:01:53,753 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_50 !
    2018-04-16 18:01:53,753 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_51 !
    2018-04-16 18:01:53,753 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_52 !
    2018-04-16 18:01:53,753 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_43 !
    2018-04-16 18:01:53,754 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_44 !
    2018-04-16 18:01:53,754 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_45 !
    2018-04-16 18:01:53,754 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_46 !
    2018-04-16 18:01:53,754 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_47 !
    2018-04-16 18:01:53,754 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_49 !
    2018-04-16 18:01:53,754 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_40 !
    2018-04-16 18:01:53,754 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_75 !
    2018-04-16 18:01:53,754 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_76 !
    2018-04-16 18:01:53,754 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_79 !
    2018-04-16 18:01:53,754 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_71 !
    2018-04-16 18:01:53,754 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_72 !
    2018-04-16 18:01:53,755 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_74 !
    2018-04-16 18:01:53,755 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_64 !
    2018-04-16 18:01:53,755 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_65 !
    2018-04-16 18:01:53,755 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_66 !
    2018-04-16 18:01:53,755 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_67 !
    2018-04-16 18:01:53,755 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_69 !
    2018-04-16 18:01:53,755 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_60 !
    2018-04-16 18:01:53,755 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_63 !
    2018-04-16 18:01:53,755 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_2 !
    2018-04-16 18:01:53,755 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_17 !
    2018-04-16 18:01:53,756 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_18 !
    2018-04-16 18:01:53,756 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_19 !
    2018-04-16 18:01:53,756 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_5 !
    2018-04-16 18:01:53,756 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_6 !
    2018-04-16 18:01:53,756 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_7 !
    2018-04-16 18:01:53,756 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_8 !
    2018-04-16 18:01:53,756 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_9 !
    2018-04-16 18:01:53,756 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_10 !
    2018-04-16 18:01:53,756 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_11 !
    2018-04-16 18:01:53,757 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_12 !
    2018-04-16 18:01:53,757 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_14 !
    2018-04-16 18:01:53,757 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_16 !
    2018-04-16 18:01:53,757 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_602 !
    2018-04-16 18:01:53,757 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_603 !
    2018-04-16 18:01:53,757 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_600 !
    2018-04-16 18:01:53,757 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_601 !
    2018-04-16 18:01:53,757 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_606 !
    2018-04-16 18:01:53,757 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_607 !
    2018-04-16 18:01:53,758 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_604 !
    2018-04-16 18:01:53,758 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_0 !
    2018-04-16 18:01:53,758 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_608 !
    2018-04-16 18:01:53,758 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_1 !
    2018-04-16 18:01:53,758 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_609 !
    2018-04-16 18:01:53,758 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_39 !
    2018-04-16 18:01:53,758 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_31 !
    2018-04-16 18:01:53,758 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_32 !
    2018-04-16 18:01:53,758 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_33 !
    2018-04-16 18:01:53,758 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_34 !
    2018-04-16 18:01:53,759 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_35 !
    2018-04-16 18:01:53,759 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_36 !
    2018-04-16 18:01:53,759 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_37 !
    2018-04-16 18:01:53,759 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_38 !
    2018-04-16 18:01:53,759 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_29 !
    2018-04-16 18:01:53,759 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_20 !
    2018-04-16 18:01:53,759 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_21 !
    2018-04-16 18:01:53,759 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_22 !
    2018-04-16 18:01:53,759 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_23 !
    2018-04-16 18:01:53,759 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_24 !
    2018-04-16 18:01:53,760 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_25 !
    2018-04-16 18:01:53,760 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_510 !
    2018-04-16 18:01:53,760 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_511 !
    2018-04-16 18:01:53,760 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_514 !
    2018-04-16 18:01:53,760 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_515 !
    2018-04-16 18:01:53,760 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_513 !
    2018-04-16 18:01:53,760 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_518 !
    2018-04-16 18:01:53,760 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_519 !
    2018-04-16 18:01:53,760 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_516 !
    2018-04-16 18:01:53,760 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_517 !
    2018-04-16 18:01:53,761 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_521 !
    2018-04-16 18:01:53,761 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_400 !
    2018-04-16 18:01:53,761 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_401 !
    2018-04-16 18:01:53,761 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_404 !
    2018-04-16 18:01:53,761 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_525 !
    2018-04-16 18:01:53,761 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_526 !
    2018-04-16 18:01:53,761 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_405 !
    2018-04-16 18:01:53,761 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_523 !
    2018-04-16 18:01:53,761 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_524 !
    2018-04-16 18:01:53,761 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_403 !
    2018-04-16 18:01:53,762 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_408 !
    2018-04-16 18:01:53,762 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_529 !
    2018-04-16 18:01:53,762 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_409 !
    2018-04-16 18:01:53,762 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_406 !
    2018-04-16 18:01:53,762 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_527 !
    2018-04-16 18:01:53,762 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_407 !
    2018-04-16 18:01:53,762 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_610 !
    2018-04-16 18:01:53,762 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_614 !
    2018-04-16 18:01:53,762 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_612 !
    2018-04-16 18:01:53,762 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_615 !
    2018-04-16 18:01:53,762 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_616 !
    2018-04-16 18:01:53,763 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_500 !
    2018-04-16 18:01:53,763 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_503 !
    2018-04-16 18:01:53,763 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_504 !
    2018-04-16 18:01:53,763 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_502 !
    2018-04-16 18:01:53,763 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_507 !
    2018-04-16 18:01:53,763 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_508 !
    2018-04-16 18:01:53,763 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_509 !
    2018-04-16 18:01:53,763 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_97 !
    2018-04-16 18:01:53,763 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_98 !
    2018-04-16 18:01:53,764 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_99 !
    2018-04-16 18:01:53,764 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_561 !
    2018-04-16 18:01:53,764 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_562 !
    2018-04-16 18:01:53,764 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_441 !
    2018-04-16 18:01:53,764 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_560 !
    2018-04-16 18:01:53,764 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_312 !
    2018-04-16 18:01:53,764 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_554 !
    2018-04-16 18:01:53,764 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_434 !
    2018-04-16 18:01:53,764 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_431 !
    2018-04-16 18:01:53,764 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_311 !
    2018-04-16 18:01:53,764 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_432 !
    2018-04-16 18:01:53,765 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_316 !
    2018-04-16 18:01:53,765 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_93 !
    2018-04-16 18:01:53,765 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_437 !
    2018-04-16 18:01:53,765 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_558 !
    2018-04-16 18:01:53,765 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_94 !
    2018-04-16 18:01:53,765 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_559 !
    2018-04-16 18:01:53,765 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_317 !
    2018-04-16 18:01:53,765 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_556 !
    2018-04-16 18:01:53,765 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_95 !
    2018-04-16 18:01:53,765 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_96 !
    2018-04-16 18:01:53,766 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_557 !
    2018-04-16 18:01:53,766 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_315 !
    2018-04-16 18:01:53,766 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_436 !
    2018-04-16 18:01:53,766 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_439 !
    2018-04-16 18:01:53,766 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_318 !
    2018-04-16 18:01:53,766 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_319 !
    2018-04-16 18:01:53,766 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_86 !
    2018-04-16 18:01:53,766 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_87 !
    2018-04-16 18:01:53,766 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_89 !
    2018-04-16 18:01:53,766 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_451 !
    2018-04-16 18:01:53,767 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_572 !
    2018-04-16 18:01:53,767 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_330 !
    2018-04-16 18:01:53,767 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_331 !
    2018-04-16 18:01:53,767 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_573 !
    2018-04-16 18:01:53,767 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_210 !
    2018-04-16 18:01:53,767 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_452 !
    2018-04-16 18:01:53,767 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_571 !
    2018-04-16 18:01:53,767 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_450 !
    2018-04-16 18:01:53,767 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_323 !
    2018-04-16 18:01:53,767 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_202 !
    2018-04-16 18:01:53,768 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_445 !
    2018-04-16 18:01:53,768 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_324 !
    2018-04-16 18:01:53,768 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_566 !
    2018-04-16 18:01:53,768 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_203 !
    2018-04-16 18:01:53,768 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_200 !
    2018-04-16 18:01:53,768 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_321 !
    2018-04-16 18:01:53,768 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_564 !
    2018-04-16 18:01:53,768 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_322 !
    2018-04-16 18:01:53,768 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_81 !
    2018-04-16 18:01:53,768 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_82 !
    2018-04-16 18:01:53,769 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_327 !
    2018-04-16 18:01:53,769 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_569 !
    2018-04-16 18:01:53,769 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_206 !
    2018-04-16 18:01:53,769 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_449 !
    2018-04-16 18:01:53,769 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_328 !
    2018-04-16 18:01:53,769 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_83 !
    2018-04-16 18:01:53,769 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_84 !
    2018-04-16 18:01:53,769 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_567 !
    2018-04-16 18:01:53,769 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_205 !
    2018-04-16 18:01:53,769 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_326 !
    2018-04-16 18:01:53,770 WARN [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:66] No more replicas available for rdd_329_447 !
    ....
    available for rdd_329_146 !
    2018-04-16 18:01:53,794 INFO [dispatcher-event-loop-4] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:54] Removing block manager BlockManagerId(34, 10.42.123.220, 41352, None)
    2018-04-16 18:01:53,795 INFO [dag-scheduler-event-loop] o.a.s.s.BlockManagerMaster [Logging.scala:54] Removed 34 successfully in removeExecutor
    2018-04-16 18:01:53,795 INFO [dag-scheduler-event-loop] o.a.s.s.DAGScheduler [Logging.scala:54] Shuffle files lost for executor: 34 (epoch 34)
    2018-04-16 18:01:53,795 INFO [dag-scheduler-event-loop] o.a.s.s.ShuffleMapStage [Logging.scala:54] ShuffleMapStage 11 is now unavailable on executor 34 (0/1320, false)
    2018-04-16 18:01:53,955 INFO [dispatcher-event-loop-11] o.a.s.d.c.StandaloneAppClient$ClientEndpoint [Logging.scala:54] Executor updated: app-20180416092531-0001/34 is now EXITED (Command exited with code 137)
    2018-04-16 18:01:53,956 INFO [dispatcher-event-loop-11] o.a.s.s.c.StandaloneSchedulerBackend [Logging.scala:54] Executor app-20180416092531-0001/34 removed: Command exited with code 137
    2018-04-16 18:01:53,956 INFO [dispatcher-event-loop-11] o.a.s.s.BlockManagerMaster [Logging.scala:54] Removal of executor 34 requested
    2018-04-16 18:01:53,957 INFO [dispatcher-event-loop-9] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:54] Trying to remove executor 34 from BlockManagerMaster.
    2018-04-16 18:01:53,957 INFO [dispatcher-event-loop-11] o.a.s.s.c.CoarseGrainedSchedulerBackend$DriverEndpoint [Logging.scala:54] Asked to remove non-existent executor 34
    2018-04-16 18:01:53,958 INFO [dispatcher-event-loop-0] o.a.s.d.c.StandaloneAppClient$ClientEndpoint [Logging.scala:54] Executor added: app-20180416092531-0001/35 on worker-20180416090258-10.42.123.220-35640 (10.42.123.220:35640) with 8 cores
    2018-04-16 18:01:53,958 INFO [dispatcher-event-loop-0] o.a.s.s.c.StandaloneSchedulerBackend [Logging.scala:54] Granted executor ID app-20180416092531-0001/35 on hostPort 10.42.123.220:35640 with 8 cores, 4.0 GB RAM
    2018-04-16 18:01:54,143 INFO [dispatcher-event-loop-1] o.a.s.d.c.StandaloneAppClient$ClientEndpoint [Logging.scala:54] Executor updated: app-20180416092531-0001/35 is now RUNNING
    2018-04-16 18:02:41,526 INFO [dispatcher-event-loop-0] o.a.s.s.c.CoarseGrainedSchedulerBackend$DriverEndpoint [Logging.scala:54] Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.42.123.220:46230) with ID 35
    2018-04-16 18:02:41,529 INFO [dispatcher-event-loop-0] o.a.s.s.TaskSetManager [Logging.scala:54] Starting task 190.19 in stage 11.0 (TID 14490, 10.42.123.220, executor 35, partition 190, PROCESS_LOCAL, 213702 bytes)
    2018-04-16 18:02:41,531 INFO [dispatcher-event-loop-0] o.a.s.s.TaskSetManager [Logging.scala:54] Starting task 102.16 in stage 11.0 (TID 14491, 10.42.123.220, executor 35, partition 102, PROCESS_LOCAL, 209783 bytes)
    2018-04-16 18:02:41,534 INFO [dispatcher-event-loop-0] o.a.s.s.TaskSetManager [Logging.scala:54] Starting task 577.10 in stage 11.0 (TID 14492, 10.42.123.220, executor 35, partition 577, PROCESS_LOCAL, 259277 bytes)
    2018-04-16 18:02:41,536 INFO [dispatcher-event-loop-0] o.a.s.s.TaskSetManager [Logging.scala:54] Starting task 302.18 in stage 11.0 (TID 14493, 10.42.123.220, executor 35, partition 302, PROCESS_LOCAL, 260706 bytes)
    2018-04-16 18:02:41,538 INFO [dispatcher-event-loop-0] o.a.s.s.TaskSetManager [Logging.scala:54] Starting task 592.5 in stage 11.0 (TID 14494, 10.42.123.220, executor 35, partition 592, PROCESS_LOCAL, 256686 bytes)
    2018-04-16 18:02:41,541 INFO [dispatcher-event-loop-0] o.a.s.s.TaskSetManager [Logging.scala:54] Starting task 310.19 in stage 11.0 (TID 14495, 10.42.123.220, executor 35, partition 310, PROCESS_LOCAL, 261343 bytes)
    2018-04-16 18:02:41,543 INFO [dispatcher-event-loop-0] o.a.s.s.TaskSetManager [Logging.scala:54] Starting task 343.13 in stage 11.0 (TID 14496, 10.42.123.220, executor 35, partition 343, PROCESS_LOCAL, 257803 bytes)
    2018-04-16 18:02:41,545 INFO [dispatcher-event-loop-0] o.a.s.s.TaskSetManager [Logging.scala:54] Starting task 191.13 in stage 11.0 (TID 14497, 10.42.123.220, executor 35, partition 191, PROCESS_LOCAL, 211660 bytes)
    2018-04-16 18:02:41,862 INFO [dispatcher-event-loop-7] o.a.s.s.BlockManagerMasterEndpoint [Logging.scala:54] Registering block manager 10.42.123.220:35262 with 2004.6 MB RAM, BlockManagerId(35, 10.42.123.220, 35262, None)
    2018-04-16 18:02:45,758 INFO [dispatcher-event-loop-3] o.a.s.s.BlockManagerInfo [Logging.scala:54] Added broadcast_11_piece0 in memory on 10.42.123.220:35262 (size: 22.9 KB, free: 2004.6 MB)
    2018-04-16 18:02:50,493 INFO [dispatcher-event-loop-10] o.a.s.s.BlockManagerInfo [Logging.scala:54] Added rdd_329_310 in memory on 10.42.123.220:35262 (size: 128.1 KB, free: 2004.5 MB)
    2018-04-16 18:02:50,506 INFO [dispatcher-event-loop-8] o.a.s.s.BlockManagerInfo [Logging.scala:54] Added rdd_329_102 in memory on 10.42.123.220:35262 (size: 91.9 KB, free: 2004.4 MB)
    2018-04-16 18:02:50,509 INFO [dispatcher-event-loop-8] o.a.s.s.BlockManagerInfo [Logging.scala:54] Added rdd_329_191 in memory on 10.42.123.220:35262 (size: 95.6 KB, free: 2004.3 MB)
    2018-04-16 18:02:50,513 INFO [dispatcher-event-loop-4] o.a.s.s.BlockManagerInfo [Logging.scala:54] Added rdd_329_592 in memory on 10.42.123.220:35262 (size: 121.8 KB, free: 2004.2 MB)
    2018-04-16 18:02:50,517 INFO [dispatcher-event-loop-4] o.a.s.s.BlockManagerInfo [Logging.scala:54] Added rdd_329_343 in memory on 10.42.123.220:35262 (size: 124.4 KB, free: 2004.0 MB)
    2018-04-16 18:02:50,517 INFO [dispatcher-event-loop-4] o.a.s.s.BlockManagerInfo [Logging.scala:54] Added rdd_329_190 in memory on 10.42.123.220:35262 (size: 96.0 KB, free: 2003.9 MB)
    2018-04-16 18:02:50,521 INFO [dispatcher-event-loop-0] o.a.s.s.BlockManagerInfo [Logging.scala:54] Added rdd_329_302 in memory on 10.42.123.220:35262 (size: 127.6 KB, free: 2003.8 MB)
    2018-04-16 18:02:50,523 INFO [dispatcher-event-loop-5] o.a.s.s.BlockManagerInfo [Logging.scala:54] Added rdd_329_577 in memory on 10.42.123.220:35262 (size: 123.6 KB, free: 2003.7 MB)
    2018-04-16 18:02:55,474 INFO [dispatcher-event-loop-9] o.a.s.s.TaskSetManager [Logging.scala:54] Starting task 43.29 in stage 11.0 (TID 14498, 10.42.123.220, executor 35, partition 43, PROCESS_LOCAL, 213324 bytes)
    2018-04-16 18:02:55,475 INFO [task-result-getter-3] o.a.s.s.TaskSetManager [Logging.scala:54] Finished task 343.13 in stage 11.0 (TID 14496) in 13934 ms on 10.42.123.220 (executor 35) (1/1320)
    2018-04-16 18:02:55,480 INFO [dispatcher-event-loop-9] o.a.s.s.TaskSetManager [Logging.scala:54] Starting task 525.27 in stage 11.0 (TID 14499, 10.42.123.220, executor 35, partition 525, PROCESS_LOCAL, 258797 bytes)
    2018-04-16 18:02:55,480 INFO [task-result-getter-1] o.a.s.s.TaskSetManager [Logging.scala:54] Finished task 577.10 in stage 11.0 (TID 14492) in 13949 ms on 10.42.123.220 (executor 35) (2/1320)
    2018-04-16 18:02:55,485 INFO [dispatcher-event-loop-9] o.a.s.s.TaskSetManager [Logging.scala:54] Starting task 406.23 in stage 11.0 (TID 14500, 10.42.123.220, executor 35, partition 406, PROCESS_LOCAL, 259253 bytes)
    2018-04-16 18:02:55,486 INFO [task-result-getter-0] o.a.s.s.TaskSetManager [Loggin

    主要是driver日志中出现了
    No more replicas available for rdd 、Resubmitted ShuffleMapTask(任务反复提交)、
    Shuffle files lost for executor
    等异常信息而且job一直不出结果。

    查看spark UI
    Running Applications > 某个应用 > Applcation Detail UI > stages > tasks 某个status为失败的任务

    ExecutorLostFailure (executor 12 exited caused by one of the running tasks) Reason: Remote RPC client disassociated. Likely due to containers exceeding thresholds, or network issues. Check driver logs for WARN messages.

    原因:
    这里遇到的问题主要是因为数据源数据量过大,而机器的内存无法满足需求,导致长时间执行超时断开的情况,数据无法有效进行交互计算,因此有必要增加内存

    具体解决办法:spark应用宿主机上部署了多个虚拟机,关停其中空闲的虚拟机,给运行spark的虚拟机腾出内存空间

    展开全文
  • nested exception is org.springframework.beans.factory.NoUniqueBeanDefinitionException: No qualifying bean of type 'com.fasterxml.jackson.databind.ObjectMapper' available: more than one 'primary' bean...
  • yum安装no more mirrors to try

    千次阅读 2019-07-15 20:22:36
    原文地址:https://blog.csdn.net/qq_26769677/article/details/80439868 笔记: ...在CentOS 使用yum 安装软件的时候 出现错误no more mirrors to try,导致软件无法继续安装。 可能原因是不正当的删...
  • linux中more和less的区别

    万次阅读 2017-08-21 09:28:55
    一、more命令 more功能类似 cat ,cat命令是整个文件的内容从上到下显示在屏幕上。 more会以一页一页的显示方便使用者逐页阅读,而最基本的指令就是按空白键(space)就往下一页显示,按 b 键就会往回(back...
  • Linux下more命令高级用法

    千次阅读 2020-08-16 10:57:14
    more 命令使用方法很简单,只需在 more 之后跟上文本名即可: more file_name比如,我们要查看 /var/log/dmesg 文件,只需: more /var/log/dmesg执行结果如下图示,有 Linux 基础的朋友应该对这个结果很熟悉。 在...
  • nested exception is java.sql.SQLException: Subquery returns more than 1 row at org.springframework.security.authentication.dao.DaoAuthenticationProvider.retrieveUser(DaoAuthenticationProvider.java:...
  • 缘起 用过linux的同学应该都知道,在linux中查看文件内容有...more tail head 那么这些命令都有什么区别呢?又分别在什么时候用呢?下面一一道来。 这些命令的区别与联系 Cat Cat的语法结构 cat [选项] [文件]… ...
  • Linux more命令

    千次阅读 2019-06-27 09:38:38
    一、more命令 more命令是一个基于vi编辑器文本过滤器,它以全屏幕的方式按页显示文本文件的内容,支持vi中的关键字定位操作。more名单中内置了若干快捷键,常用的有H(获得帮助信息),Enter(向下翻滚一行),空格...
  • Linux more 命令就是这样一道非常下饭的菜,学会用它查看日志文件,也许会让很多问题及时被发现和定位。 Linux more 命令 Linux more 命令,顾名思义就是显示更多。类似 cat,不过会以一页一页的形式显示,更...
  • effective c++, more effective c++ 中英文版, epub版。提高c++ 编程能力的很好的书
  • Repository epel is listed more than once in the configuration 执行yum list命令时报错Existing lock /var/run/yum.pid: another copy is running as pid 10841. 报错出现的情况具体为: [root@xx_0_15_...
  • More Effective C++ 中文版 PDF

    热门讨论 2014-06-22 13:29:17
    More Effective C++ 中文版 PDF
  • One or more errors occurred 报错

    千次阅读 2021-05-28 21:49:04
    One or more errors occurred. (Size 18675374 is larger than MaxDocumentSize 16777216.) 原因分析: 出现以上错误的原因是MongoDB单条数据最大只能支持16MB数据的写入限制,但是开发在记录日志或者写数据的时候...
  • mysql错误:Subquery returns more than 1 row

    千次阅读 2020-03-06 10:40:45
    mysql错误:Subquery returns more than 1 rowMysql报错基于两个表信息解决方案:方案一:limit 1方案二:group_concat()方案三: any和some参考例子 Mysql报错 Mysql报错:1242 - Subquery returns more than 1 row...
  • java.sql.SQLException: The server time zone value '�й���׼ʱ��' is unrecognized or represents more than one time zone. You must configure either the server or JDBC driver (via the 'serverTime...
  • more -10 fileName : 翻页时每页显示10行 more +10 fileName:从第10行开始分页 more -d fileName :提示,在画面下方显示 [Press space to continue, ‘q’ to quit.] ,如果你按错键了会提示: [Press ‘h’ for...
  • More Effective C++(中文版).pdf More Effective C++(中文版).pdf More Effective C++(中文版).pdf

空空如也

空空如也

1 2 3 4 5 ... 20
收藏数 1,486,687
精华内容 594,674
关键字:

more