proc.txt 74 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726727728729730731732733734735736737738739740741742743744745746747748749750751752753754755756757758759760761762763764765766767768769770771772773774775776777778779780781782783784785786787788789790791792793794795796797798799800801802803804805806807808809810811812813814815816817818819820821822823824825826827828829830831832833834835836837838839840841842843844845846847848849850851852853854855856857858859860861862863864865866867868869870871872873874875876877878879880881882883884885886887888889890891892893894895896897898899900901902903904905906907908909910911912913914915916917918919920921922923924925926927928929930931932933934935936937938939940941942943944945946947948949950951952953954955956957958959960961962963964965966967968969970971972973974975976977978979980981982983984985986987988989990991992993994995996997998999100010011002100310041005100610071008100910101011101210131014101510161017101810191020102110221023102410251026102710281029103010311032103310341035103610371038103910401041104210431044104510461047104810491050105110521053105410551056105710581059106010611062106310641065106610671068106910701071107210731074107510761077107810791080108110821083108410851086108710881089109010911092109310941095109610971098109911001101110211031104110511061107110811091110111111121113111411151116111711181119112011211122112311241125112611271128112911301131113211331134113511361137113811391140114111421143114411451146114711481149115011511152115311541155115611571158115911601161116211631164116511661167116811691170117111721173117411751176117711781179118011811182118311841185118611871188118911901191119211931194119511961197119811991200120112021203120412051206120712081209121012111212121312141215121612171218121912201221122212231224122512261227122812291230123112321233123412351236123712381239124012411242124312441245124612471248124912501251125212531254125512561257125812591260126112621263126412651266126712681269127012711272127312741275127612771278127912801281128212831284128512861287128812891290129112921293129412951296129712981299130013011302130313041305130613071308130913101311131213131314131513161317131813191320132113221323132413251326132713281329133013311332133313341335133613371338133913401341134213431344134513461347134813491350135113521353135413551356135713581359136013611362136313641365136613671368136913701371137213731374137513761377137813791380138113821383138413851386138713881389139013911392139313941395139613971398139914001401140214031404140514061407140814091410141114121413141414151416141714181419142014211422142314241425142614271428142914301431143214331434143514361437143814391440144114421443144414451446144714481449145014511452145314541455145614571458145914601461146214631464146514661467146814691470147114721473147414751476147714781479148014811482148314841485148614871488148914901491149214931494149514961497149814991500150115021503150415051506150715081509151015111512151315141515151615171518151915201521152215231524152515261527152815291530153115321533153415351536153715381539154015411542154315441545154615471548154915501551155215531554155515561557155815591560156115621563156415651566156715681569157015711572157315741575157615771578157915801581158215831584158515861587158815891590159115921593159415951596159715981599160016011602160316041605160616071608160916101611161216131614
  1. ------------------------------------------------------------------------------
  2. T H E /proc F I L E S Y S T E M
  3. ------------------------------------------------------------------------------
  4. /proc/sys Terrehon Bowden <terrehon@pacbell.net> October 7 1999
  5. Bodo Bauer <bb@ricochet.net>
  6. 2.4.x update Jorge Nerin <comandante@zaralinux.com> November 14 2000
  7. move /proc/sys Shen Feng <shen@cn.fujitsu.com> April 1 2009
  8. ------------------------------------------------------------------------------
  9. Version 1.3 Kernel version 2.2.12
  10. Kernel version 2.4.0-test11-pre4
  11. ------------------------------------------------------------------------------
  12. fixes/update part 1.1 Stefani Seibold <stefani@seibold.net> June 9 2009
  13. Table of Contents
  14. -----------------
  15. 0 Preface
  16. 0.1 Introduction/Credits
  17. 0.2 Legal Stuff
  18. 1 Collecting System Information
  19. 1.1 Process-Specific Subdirectories
  20. 1.2 Kernel data
  21. 1.3 IDE devices in /proc/ide
  22. 1.4 Networking info in /proc/net
  23. 1.5 SCSI info
  24. 1.6 Parallel port info in /proc/parport
  25. 1.7 TTY info in /proc/tty
  26. 1.8 Miscellaneous kernel statistics in /proc/stat
  27. 1.9 Ext4 file system parameters
  28. 2 Modifying System Parameters
  29. 3 Per-Process Parameters
  30. 3.1 /proc/<pid>/oom_adj & /proc/<pid>/oom_score_adj - Adjust the oom-killer
  31. score
  32. 3.2 /proc/<pid>/oom_score - Display current oom-killer score
  33. 3.3 /proc/<pid>/io - Display the IO accounting fields
  34. 3.4 /proc/<pid>/coredump_filter - Core dump filtering settings
  35. 3.5 /proc/<pid>/mountinfo - Information about mounts
  36. 3.6 /proc/<pid>/comm & /proc/<pid>/task/<tid>/comm
  37. 4 Configuring procfs
  38. 4.1 Mount options
  39. ------------------------------------------------------------------------------
  40. Preface
  41. ------------------------------------------------------------------------------
  42. 0.1 Introduction/Credits
  43. ------------------------
  44. This documentation is part of a soon (or so we hope) to be released book on
  45. the SuSE Linux distribution. As there is no complete documentation for the
  46. /proc file system and we've used many freely available sources to write these
  47. chapters, it seems only fair to give the work back to the Linux community.
  48. This work is based on the 2.2.* kernel version and the upcoming 2.4.*. I'm
  49. afraid it's still far from complete, but we hope it will be useful. As far as
  50. we know, it is the first 'all-in-one' document about the /proc file system. It
  51. is focused on the Intel x86 hardware, so if you are looking for PPC, ARM,
  52. SPARC, AXP, etc., features, you probably won't find what you are looking for.
  53. It also only covers IPv4 networking, not IPv6 nor other protocols - sorry. But
  54. additions and patches are welcome and will be added to this document if you
  55. mail them to Bodo.
  56. We'd like to thank Alan Cox, Rik van Riel, and Alexey Kuznetsov and a lot of
  57. other people for help compiling this documentation. We'd also like to extend a
  58. special thank you to Andi Kleen for documentation, which we relied on heavily
  59. to create this document, as well as the additional information he provided.
  60. Thanks to everybody else who contributed source or docs to the Linux kernel
  61. and helped create a great piece of software... :)
  62. If you have any comments, corrections or additions, please don't hesitate to
  63. contact Bodo Bauer at bb@ricochet.net. We'll be happy to add them to this
  64. document.
  65. The latest version of this document is available online at
  66. http://tldp.org/LDP/Linux-Filesystem-Hierarchy/html/proc.html
  67. If the above direction does not works for you, you could try the kernel
  68. mailing list at linux-kernel@vger.kernel.org and/or try to reach me at
  69. comandante@zaralinux.com.
  70. 0.2 Legal Stuff
  71. ---------------
  72. We don't guarantee the correctness of this document, and if you come to us
  73. complaining about how you screwed up your system because of incorrect
  74. documentation, we won't feel responsible...
  75. ------------------------------------------------------------------------------
  76. CHAPTER 1: COLLECTING SYSTEM INFORMATION
  77. ------------------------------------------------------------------------------
  78. ------------------------------------------------------------------------------
  79. In This Chapter
  80. ------------------------------------------------------------------------------
  81. * Investigating the properties of the pseudo file system /proc and its
  82. ability to provide information on the running Linux system
  83. * Examining /proc's structure
  84. * Uncovering various information about the kernel and the processes running
  85. on the system
  86. ------------------------------------------------------------------------------
  87. The proc file system acts as an interface to internal data structures in the
  88. kernel. It can be used to obtain information about the system and to change
  89. certain kernel parameters at runtime (sysctl).
  90. First, we'll take a look at the read-only parts of /proc. In Chapter 2, we
  91. show you how you can use /proc/sys to change settings.
  92. 1.1 Process-Specific Subdirectories
  93. -----------------------------------
  94. The directory /proc contains (among other things) one subdirectory for each
  95. process running on the system, which is named after the process ID (PID).
  96. The link self points to the process reading the file system. Each process
  97. subdirectory has the entries listed in Table 1-1.
  98. Table 1-1: Process specific entries in /proc
  99. ..............................................................................
  100. File Content
  101. clear_refs Clears page referenced bits shown in smaps output
  102. cmdline Command line arguments
  103. cpu Current and last cpu in which it was executed (2.4)(smp)
  104. cwd Link to the current working directory
  105. environ Values of environment variables
  106. exe Link to the executable of this process
  107. fd Directory, which contains all file descriptors
  108. maps Memory maps to executables and library files (2.4)
  109. mem Memory held by this process
  110. root Link to the root directory of this process
  111. stat Process status
  112. statm Process memory status information
  113. status Process status in human readable form
  114. wchan If CONFIG_KALLSYMS is set, a pre-decoded wchan
  115. pagemap Page table
  116. stack Report full stack trace, enable via CONFIG_STACKTRACE
  117. smaps a extension based on maps, showing the memory consumption of
  118. each mapping
  119. ..............................................................................
  120. For example, to get the status information of a process, all you have to do is
  121. read the file /proc/PID/status:
  122. >cat /proc/self/status
  123. Name: cat
  124. State: R (running)
  125. Tgid: 5452
  126. Pid: 5452
  127. PPid: 743
  128. TracerPid: 0 (2.4)
  129. Uid: 501 501 501 501
  130. Gid: 100 100 100 100
  131. FDSize: 256
  132. Groups: 100 14 16
  133. VmPeak: 5004 kB
  134. VmSize: 5004 kB
  135. VmLck: 0 kB
  136. VmHWM: 476 kB
  137. VmRSS: 476 kB
  138. VmData: 156 kB
  139. VmStk: 88 kB
  140. VmExe: 68 kB
  141. VmLib: 1412 kB
  142. VmPTE: 20 kb
  143. VmSwap: 0 kB
  144. Threads: 1
  145. SigQ: 0/28578
  146. SigPnd: 0000000000000000
  147. ShdPnd: 0000000000000000
  148. SigBlk: 0000000000000000
  149. SigIgn: 0000000000000000
  150. SigCgt: 0000000000000000
  151. CapInh: 00000000fffffeff
  152. CapPrm: 0000000000000000
  153. CapEff: 0000000000000000
  154. CapBnd: ffffffffffffffff
  155. voluntary_ctxt_switches: 0
  156. nonvoluntary_ctxt_switches: 1
  157. This shows you nearly the same information you would get if you viewed it with
  158. the ps command. In fact, ps uses the proc file system to obtain its
  159. information. But you get a more detailed view of the process by reading the
  160. file /proc/PID/status. It fields are described in table 1-2.
  161. The statm file contains more detailed information about the process
  162. memory usage. Its seven fields are explained in Table 1-3. The stat file
  163. contains details information about the process itself. Its fields are
  164. explained in Table 1-4.
  165. (for SMP CONFIG users)
  166. For making accounting scalable, RSS related information are handled in
  167. asynchronous manner and the vaule may not be very precise. To see a precise
  168. snapshot of a moment, you can see /proc/<pid>/smaps file and scan page table.
  169. It's slow but very precise.
  170. Table 1-2: Contents of the status files (as of 2.6.30-rc7)
  171. ..............................................................................
  172. Field Content
  173. Name filename of the executable
  174. State state (R is running, S is sleeping, D is sleeping
  175. in an uninterruptible wait, Z is zombie,
  176. T is traced or stopped)
  177. Tgid thread group ID
  178. Pid process id
  179. PPid process id of the parent process
  180. TracerPid PID of process tracing this process (0 if not)
  181. Uid Real, effective, saved set, and file system UIDs
  182. Gid Real, effective, saved set, and file system GIDs
  183. FDSize number of file descriptor slots currently allocated
  184. Groups supplementary group list
  185. VmPeak peak virtual memory size
  186. VmSize total program size
  187. VmLck locked memory size
  188. VmHWM peak resident set size ("high water mark")
  189. VmRSS size of memory portions
  190. VmData size of data, stack, and text segments
  191. VmStk size of data, stack, and text segments
  192. VmExe size of text segment
  193. VmLib size of shared library code
  194. VmPTE size of page table entries
  195. VmSwap size of swap usage (the number of referred swapents)
  196. Threads number of threads
  197. SigQ number of signals queued/max. number for queue
  198. SigPnd bitmap of pending signals for the thread
  199. ShdPnd bitmap of shared pending signals for the process
  200. SigBlk bitmap of blocked signals
  201. SigIgn bitmap of ignored signals
  202. SigCgt bitmap of catched signals
  203. CapInh bitmap of inheritable capabilities
  204. CapPrm bitmap of permitted capabilities
  205. CapEff bitmap of effective capabilities
  206. CapBnd bitmap of capabilities bounding set
  207. Cpus_allowed mask of CPUs on which this process may run
  208. Cpus_allowed_list Same as previous, but in "list format"
  209. Mems_allowed mask of memory nodes allowed to this process
  210. Mems_allowed_list Same as previous, but in "list format"
  211. voluntary_ctxt_switches number of voluntary context switches
  212. nonvoluntary_ctxt_switches number of non voluntary context switches
  213. ..............................................................................
  214. Table 1-3: Contents of the statm files (as of 2.6.8-rc3)
  215. ..............................................................................
  216. Field Content
  217. size total program size (pages) (same as VmSize in status)
  218. resident size of memory portions (pages) (same as VmRSS in status)
  219. shared number of pages that are shared (i.e. backed by a file)
  220. trs number of pages that are 'code' (not including libs; broken,
  221. includes data segment)
  222. lrs number of pages of library (always 0 on 2.6)
  223. drs number of pages of data/stack (including libs; broken,
  224. includes library text)
  225. dt number of dirty pages (always 0 on 2.6)
  226. ..............................................................................
  227. Table 1-4: Contents of the stat files (as of 2.6.30-rc7)
  228. ..............................................................................
  229. Field Content
  230. pid process id
  231. tcomm filename of the executable
  232. state state (R is running, S is sleeping, D is sleeping in an
  233. uninterruptible wait, Z is zombie, T is traced or stopped)
  234. ppid process id of the parent process
  235. pgrp pgrp of the process
  236. sid session id
  237. tty_nr tty the process uses
  238. tty_pgrp pgrp of the tty
  239. flags task flags
  240. min_flt number of minor faults
  241. cmin_flt number of minor faults with child's
  242. maj_flt number of major faults
  243. cmaj_flt number of major faults with child's
  244. utime user mode jiffies
  245. stime kernel mode jiffies
  246. cutime user mode jiffies with child's
  247. cstime kernel mode jiffies with child's
  248. priority priority level
  249. nice nice level
  250. num_threads number of threads
  251. it_real_value (obsolete, always 0)
  252. start_time time the process started after system boot
  253. vsize virtual memory size
  254. rss resident set memory size
  255. rsslim current limit in bytes on the rss
  256. start_code address above which program text can run
  257. end_code address below which program text can run
  258. start_stack address of the start of the main process stack
  259. esp current value of ESP
  260. eip current value of EIP
  261. pending bitmap of pending signals
  262. blocked bitmap of blocked signals
  263. sigign bitmap of ignored signals
  264. sigcatch bitmap of catched signals
  265. wchan address where process went to sleep
  266. 0 (place holder)
  267. 0 (place holder)
  268. exit_signal signal to send to parent thread on exit
  269. task_cpu which CPU the task is scheduled on
  270. rt_priority realtime priority
  271. policy scheduling policy (man sched_setscheduler)
  272. blkio_ticks time spent waiting for block IO
  273. gtime guest time of the task in jiffies
  274. cgtime guest time of the task children in jiffies
  275. start_data address above which program data+bss is placed
  276. end_data address below which program data+bss is placed
  277. start_brk address above which program heap can be expanded with brk()
  278. ..............................................................................
  279. The /proc/PID/maps file containing the currently mapped memory regions and
  280. their access permissions.
  281. The format is:
  282. address perms offset dev inode pathname
  283. 08048000-08049000 r-xp 00000000 03:00 8312 /opt/test
  284. 08049000-0804a000 rw-p 00001000 03:00 8312 /opt/test
  285. 0804a000-0806b000 rw-p 00000000 00:00 0 [heap]
  286. a7cb1000-a7cb2000 ---p 00000000 00:00 0
  287. a7cb2000-a7eb2000 rw-p 00000000 00:00 0
  288. a7eb2000-a7eb3000 ---p 00000000 00:00 0
  289. a7eb3000-a7ed5000 rw-p 00000000 00:00 0 [stack:1001]
  290. a7ed5000-a8008000 r-xp 00000000 03:00 4222 /lib/libc.so.6
  291. a8008000-a800a000 r--p 00133000 03:00 4222 /lib/libc.so.6
  292. a800a000-a800b000 rw-p 00135000 03:00 4222 /lib/libc.so.6
  293. a800b000-a800e000 rw-p 00000000 00:00 0
  294. a800e000-a8022000 r-xp 00000000 03:00 14462 /lib/libpthread.so.0
  295. a8022000-a8023000 r--p 00013000 03:00 14462 /lib/libpthread.so.0
  296. a8023000-a8024000 rw-p 00014000 03:00 14462 /lib/libpthread.so.0
  297. a8024000-a8027000 rw-p 00000000 00:00 0
  298. a8027000-a8043000 r-xp 00000000 03:00 8317 /lib/ld-linux.so.2
  299. a8043000-a8044000 r--p 0001b000 03:00 8317 /lib/ld-linux.so.2
  300. a8044000-a8045000 rw-p 0001c000 03:00 8317 /lib/ld-linux.so.2
  301. aff35000-aff4a000 rw-p 00000000 00:00 0 [stack]
  302. ffffe000-fffff000 r-xp 00000000 00:00 0 [vdso]
  303. where "address" is the address space in the process that it occupies, "perms"
  304. is a set of permissions:
  305. r = read
  306. w = write
  307. x = execute
  308. s = shared
  309. p = private (copy on write)
  310. "offset" is the offset into the mapping, "dev" is the device (major:minor), and
  311. "inode" is the inode on that device. 0 indicates that no inode is associated
  312. with the memory region, as the case would be with BSS (uninitialized data).
  313. The "pathname" shows the name associated file for this mapping. If the mapping
  314. is not associated with a file:
  315. [heap] = the heap of the program
  316. [stack] = the stack of the main process
  317. [stack:1001] = the stack of the thread with tid 1001
  318. [vdso] = the "virtual dynamic shared object",
  319. the kernel system call handler
  320. or if empty, the mapping is anonymous.
  321. The /proc/PID/task/TID/maps is a view of the virtual memory from the viewpoint
  322. of the individual tasks of a process. In this file you will see a mapping marked
  323. as [stack] if that task sees it as a stack. This is a key difference from the
  324. content of /proc/PID/maps, where you will see all mappings that are being used
  325. as stack by all of those tasks. Hence, for the example above, the task-level
  326. map, i.e. /proc/PID/task/TID/maps for thread 1001 will look like this:
  327. 08048000-08049000 r-xp 00000000 03:00 8312 /opt/test
  328. 08049000-0804a000 rw-p 00001000 03:00 8312 /opt/test
  329. 0804a000-0806b000 rw-p 00000000 00:00 0 [heap]
  330. a7cb1000-a7cb2000 ---p 00000000 00:00 0
  331. a7cb2000-a7eb2000 rw-p 00000000 00:00 0
  332. a7eb2000-a7eb3000 ---p 00000000 00:00 0
  333. a7eb3000-a7ed5000 rw-p 00000000 00:00 0 [stack]
  334. a7ed5000-a8008000 r-xp 00000000 03:00 4222 /lib/libc.so.6
  335. a8008000-a800a000 r--p 00133000 03:00 4222 /lib/libc.so.6
  336. a800a000-a800b000 rw-p 00135000 03:00 4222 /lib/libc.so.6
  337. a800b000-a800e000 rw-p 00000000 00:00 0
  338. a800e000-a8022000 r-xp 00000000 03:00 14462 /lib/libpthread.so.0
  339. a8022000-a8023000 r--p 00013000 03:00 14462 /lib/libpthread.so.0
  340. a8023000-a8024000 rw-p 00014000 03:00 14462 /lib/libpthread.so.0
  341. a8024000-a8027000 rw-p 00000000 00:00 0
  342. a8027000-a8043000 r-xp 00000000 03:00 8317 /lib/ld-linux.so.2
  343. a8043000-a8044000 r--p 0001b000 03:00 8317 /lib/ld-linux.so.2
  344. a8044000-a8045000 rw-p 0001c000 03:00 8317 /lib/ld-linux.so.2
  345. aff35000-aff4a000 rw-p 00000000 00:00 0
  346. ffffe000-fffff000 r-xp 00000000 00:00 0 [vdso]
  347. The /proc/PID/smaps is an extension based on maps, showing the memory
  348. consumption for each of the process's mappings. For each of mappings there
  349. is a series of lines such as the following:
  350. 08048000-080bc000 r-xp 00000000 03:02 13130 /bin/bash
  351. Size: 1084 kB
  352. Rss: 892 kB
  353. Pss: 374 kB
  354. Shared_Clean: 892 kB
  355. Shared_Dirty: 0 kB
  356. Private_Clean: 0 kB
  357. Private_Dirty: 0 kB
  358. Referenced: 892 kB
  359. Anonymous: 0 kB
  360. Swap: 0 kB
  361. KernelPageSize: 4 kB
  362. MMUPageSize: 4 kB
  363. Locked: 374 kB
  364. The first of these lines shows the same information as is displayed for the
  365. mapping in /proc/PID/maps. The remaining lines show the size of the mapping
  366. (size), the amount of the mapping that is currently resident in RAM (RSS), the
  367. process' proportional share of this mapping (PSS), the number of clean and
  368. dirty private pages in the mapping. Note that even a page which is part of a
  369. MAP_SHARED mapping, but has only a single pte mapped, i.e. is currently used
  370. by only one process, is accounted as private and not as shared. "Referenced"
  371. indicates the amount of memory currently marked as referenced or accessed.
  372. "Anonymous" shows the amount of memory that does not belong to any file. Even
  373. a mapping associated with a file may contain anonymous pages: when MAP_PRIVATE
  374. and a page is modified, the file page is replaced by a private anonymous copy.
  375. "Swap" shows how much would-be-anonymous memory is also used, but out on
  376. swap.
  377. This file is only present if the CONFIG_MMU kernel configuration option is
  378. enabled.
  379. The /proc/PID/clear_refs is used to reset the PG_Referenced and ACCESSED/YOUNG
  380. bits on both physical and virtual pages associated with a process.
  381. To clear the bits for all the pages associated with the process
  382. > echo 1 > /proc/PID/clear_refs
  383. To clear the bits for the anonymous pages associated with the process
  384. > echo 2 > /proc/PID/clear_refs
  385. To clear the bits for the file mapped pages associated with the process
  386. > echo 3 > /proc/PID/clear_refs
  387. Any other value written to /proc/PID/clear_refs will have no effect.
  388. The /proc/pid/pagemap gives the PFN, which can be used to find the pageflags
  389. using /proc/kpageflags and number of times a page is mapped using
  390. /proc/kpagecount. For detailed explanation, see Documentation/vm/pagemap.txt.
  391. 1.2 Kernel data
  392. ---------------
  393. Similar to the process entries, the kernel data files give information about
  394. the running kernel. The files used to obtain this information are contained in
  395. /proc and are listed in Table 1-5. Not all of these will be present in your
  396. system. It depends on the kernel configuration and the loaded modules, which
  397. files are there, and which are missing.
  398. Table 1-5: Kernel info in /proc
  399. ..............................................................................
  400. File Content
  401. apm Advanced power management info
  402. buddyinfo Kernel memory allocator information (see text) (2.5)
  403. bus Directory containing bus specific information
  404. cmdline Kernel command line
  405. cpuinfo Info about the CPU
  406. devices Available devices (block and character)
  407. dma Used DMS channels
  408. filesystems Supported filesystems
  409. driver Various drivers grouped here, currently rtc (2.4)
  410. execdomains Execdomains, related to security (2.4)
  411. fb Frame Buffer devices (2.4)
  412. fs File system parameters, currently nfs/exports (2.4)
  413. ide Directory containing info about the IDE subsystem
  414. interrupts Interrupt usage
  415. iomem Memory map (2.4)
  416. ioports I/O port usage
  417. irq Masks for irq to cpu affinity (2.4)(smp?)
  418. isapnp ISA PnP (Plug&Play) Info (2.4)
  419. kcore Kernel core image (can be ELF or A.OUT(deprecated in 2.4))
  420. kmsg Kernel messages
  421. ksyms Kernel symbol table
  422. loadavg Load average of last 1, 5 & 15 minutes
  423. locks Kernel locks
  424. meminfo Memory info
  425. misc Miscellaneous
  426. modules List of loaded modules
  427. mounts Mounted filesystems
  428. net Networking info (see text)
  429. pagetypeinfo Additional page allocator information (see text) (2.5)
  430. partitions Table of partitions known to the system
  431. pci Deprecated info of PCI bus (new way -> /proc/bus/pci/,
  432. decoupled by lspci (2.4)
  433. rtc Real time clock
  434. scsi SCSI info (see text)
  435. slabinfo Slab pool info
  436. softirqs softirq usage
  437. stat Overall statistics
  438. swaps Swap space utilization
  439. sys See chapter 2
  440. sysvipc Info of SysVIPC Resources (msg, sem, shm) (2.4)
  441. tty Info of tty drivers
  442. uptime System uptime
  443. version Kernel version
  444. video bttv info of video resources (2.4)
  445. vmallocinfo Show vmalloced areas
  446. ..............................................................................
  447. You can, for example, check which interrupts are currently in use and what
  448. they are used for by looking in the file /proc/interrupts:
  449. > cat /proc/interrupts
  450. CPU0
  451. 0: 8728810 XT-PIC timer
  452. 1: 895 XT-PIC keyboard
  453. 2: 0 XT-PIC cascade
  454. 3: 531695 XT-PIC aha152x
  455. 4: 2014133 XT-PIC serial
  456. 5: 44401 XT-PIC pcnet_cs
  457. 8: 2 XT-PIC rtc
  458. 11: 8 XT-PIC i82365
  459. 12: 182918 XT-PIC PS/2 Mouse
  460. 13: 1 XT-PIC fpu
  461. 14: 1232265 XT-PIC ide0
  462. 15: 7 XT-PIC ide1
  463. NMI: 0
  464. In 2.4.* a couple of lines where added to this file LOC & ERR (this time is the
  465. output of a SMP machine):
  466. > cat /proc/interrupts
  467. CPU0 CPU1
  468. 0: 1243498 1214548 IO-APIC-edge timer
  469. 1: 8949 8958 IO-APIC-edge keyboard
  470. 2: 0 0 XT-PIC cascade
  471. 5: 11286 10161 IO-APIC-edge soundblaster
  472. 8: 1 0 IO-APIC-edge rtc
  473. 9: 27422 27407 IO-APIC-edge 3c503
  474. 12: 113645 113873 IO-APIC-edge PS/2 Mouse
  475. 13: 0 0 XT-PIC fpu
  476. 14: 22491 24012 IO-APIC-edge ide0
  477. 15: 2183 2415 IO-APIC-edge ide1
  478. 17: 30564 30414 IO-APIC-level eth0
  479. 18: 177 164 IO-APIC-level bttv
  480. NMI: 2457961 2457959
  481. LOC: 2457882 2457881
  482. ERR: 2155
  483. NMI is incremented in this case because every timer interrupt generates a NMI
  484. (Non Maskable Interrupt) which is used by the NMI Watchdog to detect lockups.
  485. LOC is the local interrupt counter of the internal APIC of every CPU.
  486. ERR is incremented in the case of errors in the IO-APIC bus (the bus that
  487. connects the CPUs in a SMP system. This means that an error has been detected,
  488. the IO-APIC automatically retry the transmission, so it should not be a big
  489. problem, but you should read the SMP-FAQ.
  490. In 2.6.2* /proc/interrupts was expanded again. This time the goal was for
  491. /proc/interrupts to display every IRQ vector in use by the system, not
  492. just those considered 'most important'. The new vectors are:
  493. THR -- interrupt raised when a machine check threshold counter
  494. (typically counting ECC corrected errors of memory or cache) exceeds
  495. a configurable threshold. Only available on some systems.
  496. TRM -- a thermal event interrupt occurs when a temperature threshold
  497. has been exceeded for the CPU. This interrupt may also be generated
  498. when the temperature drops back to normal.
  499. SPU -- a spurious interrupt is some interrupt that was raised then lowered
  500. by some IO device before it could be fully processed by the APIC. Hence
  501. the APIC sees the interrupt but does not know what device it came from.
  502. For this case the APIC will generate the interrupt with a IRQ vector
  503. of 0xff. This might also be generated by chipset bugs.
  504. RES, CAL, TLB -- rescheduling, call and TLB flush interrupts are
  505. sent from one CPU to another per the needs of the OS. Typically,
  506. their statistics are used by kernel developers and interested users to
  507. determine the occurrence of interrupts of the given type.
  508. The above IRQ vectors are displayed only when relevant. For example,
  509. the threshold vector does not exist on x86_64 platforms. Others are
  510. suppressed when the system is a uniprocessor. As of this writing, only
  511. i386 and x86_64 platforms support the new IRQ vector displays.
  512. Of some interest is the introduction of the /proc/irq directory to 2.4.
  513. It could be used to set IRQ to CPU affinity, this means that you can "hook" an
  514. IRQ to only one CPU, or to exclude a CPU of handling IRQs. The contents of the
  515. irq subdir is one subdir for each IRQ, and two files; default_smp_affinity and
  516. prof_cpu_mask.
  517. For example
  518. > ls /proc/irq/
  519. 0 10 12 14 16 18 2 4 6 8 prof_cpu_mask
  520. 1 11 13 15 17 19 3 5 7 9 default_smp_affinity
  521. > ls /proc/irq/0/
  522. smp_affinity
  523. smp_affinity is a bitmask, in which you can specify which CPUs can handle the
  524. IRQ, you can set it by doing:
  525. > echo 1 > /proc/irq/10/smp_affinity
  526. This means that only the first CPU will handle the IRQ, but you can also echo
  527. 5 which means that only the first and fourth CPU can handle the IRQ.
  528. The contents of each smp_affinity file is the same by default:
  529. > cat /proc/irq/0/smp_affinity
  530. ffffffff
  531. There is an alternate interface, smp_affinity_list which allows specifying
  532. a cpu range instead of a bitmask:
  533. > cat /proc/irq/0/smp_affinity_list
  534. 1024-1031
  535. The default_smp_affinity mask applies to all non-active IRQs, which are the
  536. IRQs which have not yet been allocated/activated, and hence which lack a
  537. /proc/irq/[0-9]* directory.
  538. The node file on an SMP system shows the node to which the device using the IRQ
  539. reports itself as being attached. This hardware locality information does not
  540. include information about any possible driver locality preference.
  541. prof_cpu_mask specifies which CPUs are to be profiled by the system wide
  542. profiler. Default value is ffffffff (all cpus if there are only 32 of them).
  543. The way IRQs are routed is handled by the IO-APIC, and it's Round Robin
  544. between all the CPUs which are allowed to handle it. As usual the kernel has
  545. more info than you and does a better job than you, so the defaults are the
  546. best choice for almost everyone. [Note this applies only to those IO-APIC's
  547. that support "Round Robin" interrupt distribution.]
  548. There are three more important subdirectories in /proc: net, scsi, and sys.
  549. The general rule is that the contents, or even the existence of these
  550. directories, depend on your kernel configuration. If SCSI is not enabled, the
  551. directory scsi may not exist. The same is true with the net, which is there
  552. only when networking support is present in the running kernel.
  553. The slabinfo file gives information about memory usage at the slab level.
  554. Linux uses slab pools for memory management above page level in version 2.2.
  555. Commonly used objects have their own slab pool (such as network buffers,
  556. directory cache, and so on).
  557. ..............................................................................
  558. > cat /proc/buddyinfo
  559. Node 0, zone DMA 0 4 5 4 4 3 ...
  560. Node 0, zone Normal 1 0 0 1 101 8 ...
  561. Node 0, zone HighMem 2 0 0 1 1 0 ...
  562. External fragmentation is a problem under some workloads, and buddyinfo is a
  563. useful tool for helping diagnose these problems. Buddyinfo will give you a
  564. clue as to how big an area you can safely allocate, or why a previous
  565. allocation failed.
  566. Each column represents the number of pages of a certain order which are
  567. available. In this case, there are 0 chunks of 2^0*PAGE_SIZE available in
  568. ZONE_DMA, 4 chunks of 2^1*PAGE_SIZE in ZONE_DMA, 101 chunks of 2^4*PAGE_SIZE
  569. available in ZONE_NORMAL, etc...
  570. More information relevant to external fragmentation can be found in
  571. pagetypeinfo.
  572. > cat /proc/pagetypeinfo
  573. Page block order: 9
  574. Pages per block: 512
  575. Free pages count per migrate type at order 0 1 2 3 4 5 6 7 8 9 10
  576. Node 0, zone DMA, type Unmovable 0 0 0 1 1 1 1 1 1 1 0
  577. Node 0, zone DMA, type Reclaimable 0 0 0 0 0 0 0 0 0 0 0
  578. Node 0, zone DMA, type Movable 1 1 2 1 2 1 1 0 1 0 2
  579. Node 0, zone DMA, type Reserve 0 0 0 0 0 0 0 0 0 1 0
  580. Node 0, zone DMA, type Isolate 0 0 0 0 0 0 0 0 0 0 0
  581. Node 0, zone DMA32, type Unmovable 103 54 77 1 1 1 11 8 7 1 9
  582. Node 0, zone DMA32, type Reclaimable 0 0 2 1 0 0 0 0 1 0 0
  583. Node 0, zone DMA32, type Movable 169 152 113 91 77 54 39 13 6 1 452
  584. Node 0, zone DMA32, type Reserve 1 2 2 2 2 0 1 1 1 1 0
  585. Node 0, zone DMA32, type Isolate 0 0 0 0 0 0 0 0 0 0 0
  586. Number of blocks type Unmovable Reclaimable Movable Reserve Isolate
  587. Node 0, zone DMA 2 0 5 1 0
  588. Node 0, zone DMA32 41 6 967 2 0
  589. Fragmentation avoidance in the kernel works by grouping pages of different
  590. migrate types into the same contiguous regions of memory called page blocks.
  591. A page block is typically the size of the default hugepage size e.g. 2MB on
  592. X86-64. By keeping pages grouped based on their ability to move, the kernel
  593. can reclaim pages within a page block to satisfy a high-order allocation.
  594. The pagetypinfo begins with information on the size of a page block. It
  595. then gives the same type of information as buddyinfo except broken down
  596. by migrate-type and finishes with details on how many page blocks of each
  597. type exist.
  598. If min_free_kbytes has been tuned correctly (recommendations made by hugeadm
  599. from libhugetlbfs http://sourceforge.net/projects/libhugetlbfs/), one can
  600. make an estimate of the likely number of huge pages that can be allocated
  601. at a given point in time. All the "Movable" blocks should be allocatable
  602. unless memory has been mlock()'d. Some of the Reclaimable blocks should
  603. also be allocatable although a lot of filesystem metadata may have to be
  604. reclaimed to achieve this.
  605. ..............................................................................
  606. meminfo:
  607. Provides information about distribution and utilization of memory. This
  608. varies by architecture and compile options. The following is from a
  609. 16GB PIII, which has highmem enabled. You may not have all of these fields.
  610. > cat /proc/meminfo
  611. The "Locked" indicates whether the mapping is locked in memory or not.
  612. MemTotal: 16344972 kB
  613. MemFree: 13634064 kB
  614. Buffers: 3656 kB
  615. Cached: 1195708 kB
  616. SwapCached: 0 kB
  617. Active: 891636 kB
  618. Inactive: 1077224 kB
  619. HighTotal: 15597528 kB
  620. HighFree: 13629632 kB
  621. LowTotal: 747444 kB
  622. LowFree: 4432 kB
  623. SwapTotal: 0 kB
  624. SwapFree: 0 kB
  625. Dirty: 968 kB
  626. Writeback: 0 kB
  627. AnonPages: 861800 kB
  628. Mapped: 280372 kB
  629. Slab: 284364 kB
  630. SReclaimable: 159856 kB
  631. SUnreclaim: 124508 kB
  632. PageTables: 24448 kB
  633. NFS_Unstable: 0 kB
  634. Bounce: 0 kB
  635. WritebackTmp: 0 kB
  636. CommitLimit: 7669796 kB
  637. Committed_AS: 100056 kB
  638. VmallocTotal: 112216 kB
  639. VmallocUsed: 428 kB
  640. VmallocChunk: 111088 kB
  641. MemTotal: Total usable ram (i.e. physical ram minus a few reserved
  642. bits and the kernel binary code)
  643. MemFree: The sum of LowFree+HighFree
  644. Buffers: Relatively temporary storage for raw disk blocks
  645. shouldn't get tremendously large (20MB or so)
  646. Cached: in-memory cache for files read from the disk (the
  647. pagecache). Doesn't include SwapCached
  648. SwapCached: Memory that once was swapped out, is swapped back in but
  649. still also is in the swapfile (if memory is needed it
  650. doesn't need to be swapped out AGAIN because it is already
  651. in the swapfile. This saves I/O)
  652. Active: Memory that has been used more recently and usually not
  653. reclaimed unless absolutely necessary.
  654. Inactive: Memory which has been less recently used. It is more
  655. eligible to be reclaimed for other purposes
  656. HighTotal:
  657. HighFree: Highmem is all memory above ~860MB of physical memory
  658. Highmem areas are for use by userspace programs, or
  659. for the pagecache. The kernel must use tricks to access
  660. this memory, making it slower to access than lowmem.
  661. LowTotal:
  662. LowFree: Lowmem is memory which can be used for everything that
  663. highmem can be used for, but it is also available for the
  664. kernel's use for its own data structures. Among many
  665. other things, it is where everything from the Slab is
  666. allocated. Bad things happen when you're out of lowmem.
  667. SwapTotal: total amount of swap space available
  668. SwapFree: Memory which has been evicted from RAM, and is temporarily
  669. on the disk
  670. Dirty: Memory which is waiting to get written back to the disk
  671. Writeback: Memory which is actively being written back to the disk
  672. AnonPages: Non-file backed pages mapped into userspace page tables
  673. Mapped: files which have been mmaped, such as libraries
  674. Slab: in-kernel data structures cache
  675. SReclaimable: Part of Slab, that might be reclaimed, such as caches
  676. SUnreclaim: Part of Slab, that cannot be reclaimed on memory pressure
  677. PageTables: amount of memory dedicated to the lowest level of page
  678. tables.
  679. NFS_Unstable: NFS pages sent to the server, but not yet committed to stable
  680. storage
  681. Bounce: Memory used for block device "bounce buffers"
  682. WritebackTmp: Memory used by FUSE for temporary writeback buffers
  683. CommitLimit: Based on the overcommit ratio ('vm.overcommit_ratio'),
  684. this is the total amount of memory currently available to
  685. be allocated on the system. This limit is only adhered to
  686. if strict overcommit accounting is enabled (mode 2 in
  687. 'vm.overcommit_memory').
  688. The CommitLimit is calculated with the following formula:
  689. CommitLimit = ('vm.overcommit_ratio' * Physical RAM) + Swap
  690. For example, on a system with 1G of physical RAM and 7G
  691. of swap with a `vm.overcommit_ratio` of 30 it would
  692. yield a CommitLimit of 7.3G.
  693. For more details, see the memory overcommit documentation
  694. in vm/overcommit-accounting.
  695. Committed_AS: The amount of memory presently allocated on the system.
  696. The committed memory is a sum of all of the memory which
  697. has been allocated by processes, even if it has not been
  698. "used" by them as of yet. A process which malloc()'s 1G
  699. of memory, but only touches 300M of it will only show up
  700. as using 300M of memory even if it has the address space
  701. allocated for the entire 1G. This 1G is memory which has
  702. been "committed" to by the VM and can be used at any time
  703. by the allocating application. With strict overcommit
  704. enabled on the system (mode 2 in 'vm.overcommit_memory'),
  705. allocations which would exceed the CommitLimit (detailed
  706. above) will not be permitted. This is useful if one needs
  707. to guarantee that processes will not fail due to lack of
  708. memory once that memory has been successfully allocated.
  709. VmallocTotal: total size of vmalloc memory area
  710. VmallocUsed: amount of vmalloc area which is used
  711. VmallocChunk: largest contiguous block of vmalloc area which is free
  712. ..............................................................................
  713. vmallocinfo:
  714. Provides information about vmalloced/vmaped areas. One line per area,
  715. containing the virtual address range of the area, size in bytes,
  716. caller information of the creator, and optional information depending
  717. on the kind of area :
  718. pages=nr number of pages
  719. phys=addr if a physical address was specified
  720. ioremap I/O mapping (ioremap() and friends)
  721. vmalloc vmalloc() area
  722. vmap vmap()ed pages
  723. user VM_USERMAP area
  724. vpages buffer for pages pointers was vmalloced (huge area)
  725. N<node>=nr (Only on NUMA kernels)
  726. Number of pages allocated on memory node <node>
  727. > cat /proc/vmallocinfo
  728. 0xffffc20000000000-0xffffc20000201000 2101248 alloc_large_system_hash+0x204 ...
  729. /0x2c0 pages=512 vmalloc N0=128 N1=128 N2=128 N3=128
  730. 0xffffc20000201000-0xffffc20000302000 1052672 alloc_large_system_hash+0x204 ...
  731. /0x2c0 pages=256 vmalloc N0=64 N1=64 N2=64 N3=64
  732. 0xffffc20000302000-0xffffc20000304000 8192 acpi_tb_verify_table+0x21/0x4f...
  733. phys=7fee8000 ioremap
  734. 0xffffc20000304000-0xffffc20000307000 12288 acpi_tb_verify_table+0x21/0x4f...
  735. phys=7fee7000 ioremap
  736. 0xffffc2000031d000-0xffffc2000031f000 8192 init_vdso_vars+0x112/0x210
  737. 0xffffc2000031f000-0xffffc2000032b000 49152 cramfs_uncompress_init+0x2e ...
  738. /0x80 pages=11 vmalloc N0=3 N1=3 N2=2 N3=3
  739. 0xffffc2000033a000-0xffffc2000033d000 12288 sys_swapon+0x640/0xac0 ...
  740. pages=2 vmalloc N1=2
  741. 0xffffc20000347000-0xffffc2000034c000 20480 xt_alloc_table_info+0xfe ...
  742. /0x130 [x_tables] pages=4 vmalloc N0=4
  743. 0xffffffffa0000000-0xffffffffa000f000 61440 sys_init_module+0xc27/0x1d00 ...
  744. pages=14 vmalloc N2=14
  745. 0xffffffffa000f000-0xffffffffa0014000 20480 sys_init_module+0xc27/0x1d00 ...
  746. pages=4 vmalloc N1=4
  747. 0xffffffffa0014000-0xffffffffa0017000 12288 sys_init_module+0xc27/0x1d00 ...
  748. pages=2 vmalloc N1=2
  749. 0xffffffffa0017000-0xffffffffa0022000 45056 sys_init_module+0xc27/0x1d00 ...
  750. pages=10 vmalloc N0=10
  751. ..............................................................................
  752. softirqs:
  753. Provides counts of softirq handlers serviced since boot time, for each cpu.
  754. > cat /proc/softirqs
  755. CPU0 CPU1 CPU2 CPU3
  756. HI: 0 0 0 0
  757. TIMER: 27166 27120 27097 27034
  758. NET_TX: 0 0 0 17
  759. NET_RX: 42 0 0 39
  760. BLOCK: 0 0 107 1121
  761. TASKLET: 0 0 0 290
  762. SCHED: 27035 26983 26971 26746
  763. HRTIMER: 0 0 0 0
  764. RCU: 1678 1769 2178 2250
  765. 1.3 IDE devices in /proc/ide
  766. ----------------------------
  767. The subdirectory /proc/ide contains information about all IDE devices of which
  768. the kernel is aware. There is one subdirectory for each IDE controller, the
  769. file drivers and a link for each IDE device, pointing to the device directory
  770. in the controller specific subtree.
  771. The file drivers contains general information about the drivers used for the
  772. IDE devices:
  773. > cat /proc/ide/drivers
  774. ide-cdrom version 4.53
  775. ide-disk version 1.08
  776. More detailed information can be found in the controller specific
  777. subdirectories. These are named ide0, ide1 and so on. Each of these
  778. directories contains the files shown in table 1-6.
  779. Table 1-6: IDE controller info in /proc/ide/ide?
  780. ..............................................................................
  781. File Content
  782. channel IDE channel (0 or 1)
  783. config Configuration (only for PCI/IDE bridge)
  784. mate Mate name
  785. model Type/Chipset of IDE controller
  786. ..............................................................................
  787. Each device connected to a controller has a separate subdirectory in the
  788. controllers directory. The files listed in table 1-7 are contained in these
  789. directories.
  790. Table 1-7: IDE device information
  791. ..............................................................................
  792. File Content
  793. cache The cache
  794. capacity Capacity of the medium (in 512Byte blocks)
  795. driver driver and version
  796. geometry physical and logical geometry
  797. identify device identify block
  798. media media type
  799. model device identifier
  800. settings device setup
  801. smart_thresholds IDE disk management thresholds
  802. smart_values IDE disk management values
  803. ..............................................................................
  804. The most interesting file is settings. This file contains a nice overview of
  805. the drive parameters:
  806. # cat /proc/ide/ide0/hda/settings
  807. name value min max mode
  808. ---- ----- --- --- ----
  809. bios_cyl 526 0 65535 rw
  810. bios_head 255 0 255 rw
  811. bios_sect 63 0 63 rw
  812. breada_readahead 4 0 127 rw
  813. bswap 0 0 1 r
  814. file_readahead 72 0 2097151 rw
  815. io_32bit 0 0 3 rw
  816. keepsettings 0 0 1 rw
  817. max_kb_per_request 122 1 127 rw
  818. multcount 0 0 8 rw
  819. nice1 1 0 1 rw
  820. nowerr 0 0 1 rw
  821. pio_mode write-only 0 255 w
  822. slow 0 0 1 rw
  823. unmaskirq 0 0 1 rw
  824. using_dma 0 0 1 rw
  825. 1.4 Networking info in /proc/net
  826. --------------------------------
  827. The subdirectory /proc/net follows the usual pattern. Table 1-8 shows the
  828. additional values you get for IP version 6 if you configure the kernel to
  829. support this. Table 1-9 lists the files and their meaning.
  830. Table 1-8: IPv6 info in /proc/net
  831. ..............................................................................
  832. File Content
  833. udp6 UDP sockets (IPv6)
  834. tcp6 TCP sockets (IPv6)
  835. raw6 Raw device statistics (IPv6)
  836. igmp6 IP multicast addresses, which this host joined (IPv6)
  837. if_inet6 List of IPv6 interface addresses
  838. ipv6_route Kernel routing table for IPv6
  839. rt6_stats Global IPv6 routing tables statistics
  840. sockstat6 Socket statistics (IPv6)
  841. snmp6 Snmp data (IPv6)
  842. ..............................................................................
  843. Table 1-9: Network info in /proc/net
  844. ..............................................................................
  845. File Content
  846. arp Kernel ARP table
  847. dev network devices with statistics
  848. dev_mcast the Layer2 multicast groups a device is listening too
  849. (interface index, label, number of references, number of bound
  850. addresses).
  851. dev_stat network device status
  852. ip_fwchains Firewall chain linkage
  853. ip_fwnames Firewall chain names
  854. ip_masq Directory containing the masquerading tables
  855. ip_masquerade Major masquerading table
  856. netstat Network statistics
  857. raw raw device statistics
  858. route Kernel routing table
  859. rpc Directory containing rpc info
  860. rt_cache Routing cache
  861. snmp SNMP data
  862. sockstat Socket statistics
  863. tcp TCP sockets
  864. tr_rif Token ring RIF routing table
  865. udp UDP sockets
  866. unix UNIX domain sockets
  867. wireless Wireless interface data (Wavelan etc)
  868. igmp IP multicast addresses, which this host joined
  869. psched Global packet scheduler parameters.
  870. netlink List of PF_NETLINK sockets
  871. ip_mr_vifs List of multicast virtual interfaces
  872. ip_mr_cache List of multicast routing cache
  873. ..............................................................................
  874. You can use this information to see which network devices are available in
  875. your system and how much traffic was routed over those devices:
  876. > cat /proc/net/dev
  877. Inter-|Receive |[...
  878. face |bytes packets errs drop fifo frame compressed multicast|[...
  879. lo: 908188 5596 0 0 0 0 0 0 [...
  880. ppp0:15475140 20721 410 0 0 410 0 0 [...
  881. eth0: 614530 7085 0 0 0 0 0 1 [...
  882. ...] Transmit
  883. ...] bytes packets errs drop fifo colls carrier compressed
  884. ...] 908188 5596 0 0 0 0 0 0
  885. ...] 1375103 17405 0 0 0 0 0 0
  886. ...] 1703981 5535 0 0 0 3 0 0
  887. In addition, each Channel Bond interface has its own directory. For
  888. example, the bond0 device will have a directory called /proc/net/bond0/.
  889. It will contain information that is specific to that bond, such as the
  890. current slaves of the bond, the link status of the slaves, and how
  891. many times the slaves link has failed.
  892. 1.5 SCSI info
  893. -------------
  894. If you have a SCSI host adapter in your system, you'll find a subdirectory
  895. named after the driver for this adapter in /proc/scsi. You'll also see a list
  896. of all recognized SCSI devices in /proc/scsi:
  897. >cat /proc/scsi/scsi
  898. Attached devices:
  899. Host: scsi0 Channel: 00 Id: 00 Lun: 00
  900. Vendor: IBM Model: DGHS09U Rev: 03E0
  901. Type: Direct-Access ANSI SCSI revision: 03
  902. Host: scsi0 Channel: 00 Id: 06 Lun: 00
  903. Vendor: PIONEER Model: CD-ROM DR-U06S Rev: 1.04
  904. Type: CD-ROM ANSI SCSI revision: 02
  905. The directory named after the driver has one file for each adapter found in
  906. the system. These files contain information about the controller, including
  907. the used IRQ and the IO address range. The amount of information shown is
  908. dependent on the adapter you use. The example shows the output for an Adaptec
  909. AHA-2940 SCSI adapter:
  910. > cat /proc/scsi/aic7xxx/0
  911. Adaptec AIC7xxx driver version: 5.1.19/3.2.4
  912. Compile Options:
  913. TCQ Enabled By Default : Disabled
  914. AIC7XXX_PROC_STATS : Disabled
  915. AIC7XXX_RESET_DELAY : 5
  916. Adapter Configuration:
  917. SCSI Adapter: Adaptec AHA-294X Ultra SCSI host adapter
  918. Ultra Wide Controller
  919. PCI MMAPed I/O Base: 0xeb001000
  920. Adapter SEEPROM Config: SEEPROM found and used.
  921. Adaptec SCSI BIOS: Enabled
  922. IRQ: 10
  923. SCBs: Active 0, Max Active 2,
  924. Allocated 15, HW 16, Page 255
  925. Interrupts: 160328
  926. BIOS Control Word: 0x18b6
  927. Adapter Control Word: 0x005b
  928. Extended Translation: Enabled
  929. Disconnect Enable Flags: 0xffff
  930. Ultra Enable Flags: 0x0001
  931. Tag Queue Enable Flags: 0x0000
  932. Ordered Queue Tag Flags: 0x0000
  933. Default Tag Queue Depth: 8
  934. Tagged Queue By Device array for aic7xxx host instance 0:
  935. {255,255,255,255,255,255,255,255,255,255,255,255,255,255,255,255}
  936. Actual queue depth per device for aic7xxx host instance 0:
  937. {1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1}
  938. Statistics:
  939. (scsi0:0:0:0)
  940. Device using Wide/Sync transfers at 40.0 MByte/sec, offset 8
  941. Transinfo settings: current(12/8/1/0), goal(12/8/1/0), user(12/15/1/0)
  942. Total transfers 160151 (74577 reads and 85574 writes)
  943. (scsi0:0:6:0)
  944. Device using Narrow/Sync transfers at 5.0 MByte/sec, offset 15
  945. Transinfo settings: current(50/15/0/0), goal(50/15/0/0), user(50/15/0/0)
  946. Total transfers 0 (0 reads and 0 writes)
  947. 1.6 Parallel port info in /proc/parport
  948. ---------------------------------------
  949. The directory /proc/parport contains information about the parallel ports of
  950. your system. It has one subdirectory for each port, named after the port
  951. number (0,1,2,...).
  952. These directories contain the four files shown in Table 1-10.
  953. Table 1-10: Files in /proc/parport
  954. ..............................................................................
  955. File Content
  956. autoprobe Any IEEE-1284 device ID information that has been acquired.
  957. devices list of the device drivers using that port. A + will appear by the
  958. name of the device currently using the port (it might not appear
  959. against any).
  960. hardware Parallel port's base address, IRQ line and DMA channel.
  961. irq IRQ that parport is using for that port. This is in a separate
  962. file to allow you to alter it by writing a new value in (IRQ
  963. number or none).
  964. ..............................................................................
  965. 1.7 TTY info in /proc/tty
  966. -------------------------
  967. Information about the available and actually used tty's can be found in the
  968. directory /proc/tty.You'll find entries for drivers and line disciplines in
  969. this directory, as shown in Table 1-11.
  970. Table 1-11: Files in /proc/tty
  971. ..............................................................................
  972. File Content
  973. drivers list of drivers and their usage
  974. ldiscs registered line disciplines
  975. driver/serial usage statistic and status of single tty lines
  976. ..............................................................................
  977. To see which tty's are currently in use, you can simply look into the file
  978. /proc/tty/drivers:
  979. > cat /proc/tty/drivers
  980. pty_slave /dev/pts 136 0-255 pty:slave
  981. pty_master /dev/ptm 128 0-255 pty:master
  982. pty_slave /dev/ttyp 3 0-255 pty:slave
  983. pty_master /dev/pty 2 0-255 pty:master
  984. serial /dev/cua 5 64-67 serial:callout
  985. serial /dev/ttyS 4 64-67 serial
  986. /dev/tty0 /dev/tty0 4 0 system:vtmaster
  987. /dev/ptmx /dev/ptmx 5 2 system
  988. /dev/console /dev/console 5 1 system:console
  989. /dev/tty /dev/tty 5 0 system:/dev/tty
  990. unknown /dev/tty 4 1-63 console
  991. 1.8 Miscellaneous kernel statistics in /proc/stat
  992. -------------------------------------------------
  993. Various pieces of information about kernel activity are available in the
  994. /proc/stat file. All of the numbers reported in this file are aggregates
  995. since the system first booted. For a quick look, simply cat the file:
  996. > cat /proc/stat
  997. cpu 2255 34 2290 22625563 6290 127 456 0 0
  998. cpu0 1132 34 1441 11311718 3675 127 438 0 0
  999. cpu1 1123 0 849 11313845 2614 0 18 0 0
  1000. intr 114930548 113199788 3 0 5 263 0 4 [... lots more numbers ...]
  1001. ctxt 1990473
  1002. btime 1062191376
  1003. processes 2915
  1004. procs_running 1
  1005. procs_blocked 0
  1006. softirq 183433 0 21755 12 39 1137 231 21459 2263
  1007. The very first "cpu" line aggregates the numbers in all of the other "cpuN"
  1008. lines. These numbers identify the amount of time the CPU has spent performing
  1009. different kinds of work. Time units are in USER_HZ (typically hundredths of a
  1010. second). The meanings of the columns are as follows, from left to right:
  1011. - user: normal processes executing in user mode
  1012. - nice: niced processes executing in user mode
  1013. - system: processes executing in kernel mode
  1014. - idle: twiddling thumbs
  1015. - iowait: waiting for I/O to complete
  1016. - irq: servicing interrupts
  1017. - softirq: servicing softirqs
  1018. - steal: involuntary wait
  1019. - guest: running a normal guest
  1020. - guest_nice: running a niced guest
  1021. The "intr" line gives counts of interrupts serviced since boot time, for each
  1022. of the possible system interrupts. The first column is the total of all
  1023. interrupts serviced; each subsequent column is the total for that particular
  1024. interrupt.
  1025. The "ctxt" line gives the total number of context switches across all CPUs.
  1026. The "btime" line gives the time at which the system booted, in seconds since
  1027. the Unix epoch.
  1028. The "processes" line gives the number of processes and threads created, which
  1029. includes (but is not limited to) those created by calls to the fork() and
  1030. clone() system calls.
  1031. The "procs_running" line gives the total number of threads that are
  1032. running or ready to run (i.e., the total number of runnable threads).
  1033. The "procs_blocked" line gives the number of processes currently blocked,
  1034. waiting for I/O to complete.
  1035. The "softirq" line gives counts of softirqs serviced since boot time, for each
  1036. of the possible system softirqs. The first column is the total of all
  1037. softirqs serviced; each subsequent column is the total for that particular
  1038. softirq.
  1039. 1.9 Ext4 file system parameters
  1040. ------------------------------
  1041. Information about mounted ext4 file systems can be found in
  1042. /proc/fs/ext4. Each mounted filesystem will have a directory in
  1043. /proc/fs/ext4 based on its device name (i.e., /proc/fs/ext4/hdc or
  1044. /proc/fs/ext4/dm-0). The files in each per-device directory are shown
  1045. in Table 1-12, below.
  1046. Table 1-12: Files in /proc/fs/ext4/<devname>
  1047. ..............................................................................
  1048. File Content
  1049. mb_groups details of multiblock allocator buddy cache of free blocks
  1050. ..............................................................................
  1051. 2.0 /proc/consoles
  1052. ------------------
  1053. Shows registered system console lines.
  1054. To see which character device lines are currently used for the system console
  1055. /dev/console, you may simply look into the file /proc/consoles:
  1056. > cat /proc/consoles
  1057. tty0 -WU (ECp) 4:7
  1058. ttyS0 -W- (Ep) 4:64
  1059. The columns are:
  1060. device name of the device
  1061. operations R = can do read operations
  1062. W = can do write operations
  1063. U = can do unblank
  1064. flags E = it is enabled
  1065. C = it is preferred console
  1066. B = it is primary boot console
  1067. p = it is used for printk buffer
  1068. b = it is not a TTY but a Braille device
  1069. a = it is safe to use when cpu is offline
  1070. major:minor major and minor number of the device separated by a colon
  1071. ------------------------------------------------------------------------------
  1072. Summary
  1073. ------------------------------------------------------------------------------
  1074. The /proc file system serves information about the running system. It not only
  1075. allows access to process data but also allows you to request the kernel status
  1076. by reading files in the hierarchy.
  1077. The directory structure of /proc reflects the types of information and makes
  1078. it easy, if not obvious, where to look for specific data.
  1079. ------------------------------------------------------------------------------
  1080. ------------------------------------------------------------------------------
  1081. CHAPTER 2: MODIFYING SYSTEM PARAMETERS
  1082. ------------------------------------------------------------------------------
  1083. ------------------------------------------------------------------------------
  1084. In This Chapter
  1085. ------------------------------------------------------------------------------
  1086. * Modifying kernel parameters by writing into files found in /proc/sys
  1087. * Exploring the files which modify certain parameters
  1088. * Review of the /proc/sys file tree
  1089. ------------------------------------------------------------------------------
  1090. A very interesting part of /proc is the directory /proc/sys. This is not only
  1091. a source of information, it also allows you to change parameters within the
  1092. kernel. Be very careful when attempting this. You can optimize your system,
  1093. but you can also cause it to crash. Never alter kernel parameters on a
  1094. production system. Set up a development machine and test to make sure that
  1095. everything works the way you want it to. You may have no alternative but to
  1096. reboot the machine once an error has been made.
  1097. To change a value, simply echo the new value into the file. An example is
  1098. given below in the section on the file system data. You need to be root to do
  1099. this. You can create your own boot script to perform this every time your
  1100. system boots.
  1101. The files in /proc/sys can be used to fine tune and monitor miscellaneous and
  1102. general things in the operation of the Linux kernel. Since some of the files
  1103. can inadvertently disrupt your system, it is advisable to read both
  1104. documentation and source before actually making adjustments. In any case, be
  1105. very careful when writing to any of these files. The entries in /proc may
  1106. change slightly between the 2.1.* and the 2.2 kernel, so if there is any doubt
  1107. review the kernel documentation in the directory /usr/src/linux/Documentation.
  1108. This chapter is heavily based on the documentation included in the pre 2.2
  1109. kernels, and became part of it in version 2.2.1 of the Linux kernel.
  1110. Please see: Documentation/sysctl/ directory for descriptions of these
  1111. entries.
  1112. ------------------------------------------------------------------------------
  1113. Summary
  1114. ------------------------------------------------------------------------------
  1115. Certain aspects of kernel behavior can be modified at runtime, without the
  1116. need to recompile the kernel, or even to reboot the system. The files in the
  1117. /proc/sys tree can not only be read, but also modified. You can use the echo
  1118. command to write value into these files, thereby changing the default settings
  1119. of the kernel.
  1120. ------------------------------------------------------------------------------
  1121. ------------------------------------------------------------------------------
  1122. CHAPTER 3: PER-PROCESS PARAMETERS
  1123. ------------------------------------------------------------------------------
  1124. 3.1 /proc/<pid>/oom_adj & /proc/<pid>/oom_score_adj- Adjust the oom-killer score
  1125. --------------------------------------------------------------------------------
  1126. These file can be used to adjust the badness heuristic used to select which
  1127. process gets killed in out of memory conditions.
  1128. The badness heuristic assigns a value to each candidate task ranging from 0
  1129. (never kill) to 1000 (always kill) to determine which process is targeted. The
  1130. units are roughly a proportion along that range of allowed memory the process
  1131. may allocate from based on an estimation of its current memory and swap use.
  1132. For example, if a task is using all allowed memory, its badness score will be
  1133. 1000. If it is using half of its allowed memory, its score will be 500.
  1134. There is an additional factor included in the badness score: root
  1135. processes are given 3% extra memory over other tasks.
  1136. The amount of "allowed" memory depends on the context in which the oom killer
  1137. was called. If it is due to the memory assigned to the allocating task's cpuset
  1138. being exhausted, the allowed memory represents the set of mems assigned to that
  1139. cpuset. If it is due to a mempolicy's node(s) being exhausted, the allowed
  1140. memory represents the set of mempolicy nodes. If it is due to a memory
  1141. limit (or swap limit) being reached, the allowed memory is that configured
  1142. limit. Finally, if it is due to the entire system being out of memory, the
  1143. allowed memory represents all allocatable resources.
  1144. The value of /proc/<pid>/oom_score_adj is added to the badness score before it
  1145. is used to determine which task to kill. Acceptable values range from -1000
  1146. (OOM_SCORE_ADJ_MIN) to +1000 (OOM_SCORE_ADJ_MAX). This allows userspace to
  1147. polarize the preference for oom killing either by always preferring a certain
  1148. task or completely disabling it. The lowest possible value, -1000, is
  1149. equivalent to disabling oom killing entirely for that task since it will always
  1150. report a badness score of 0.
  1151. Consequently, it is very simple for userspace to define the amount of memory to
  1152. consider for each task. Setting a /proc/<pid>/oom_score_adj value of +500, for
  1153. example, is roughly equivalent to allowing the remainder of tasks sharing the
  1154. same system, cpuset, mempolicy, or memory controller resources to use at least
  1155. 50% more memory. A value of -500, on the other hand, would be roughly
  1156. equivalent to discounting 50% of the task's allowed memory from being considered
  1157. as scoring against the task.
  1158. For backwards compatibility with previous kernels, /proc/<pid>/oom_adj may also
  1159. be used to tune the badness score. Its acceptable values range from -16
  1160. (OOM_ADJUST_MIN) to +15 (OOM_ADJUST_MAX) and a special value of -17
  1161. (OOM_DISABLE) to disable oom killing entirely for that task. Its value is
  1162. scaled linearly with /proc/<pid>/oom_score_adj.
  1163. Writing to /proc/<pid>/oom_score_adj or /proc/<pid>/oom_adj will change the
  1164. other with its scaled value.
  1165. The value of /proc/<pid>/oom_score_adj may be reduced no lower than the last
  1166. value set by a CAP_SYS_RESOURCE process. To reduce the value any lower
  1167. requires CAP_SYS_RESOURCE.
  1168. NOTICE: /proc/<pid>/oom_adj is deprecated and will be removed, please see
  1169. Documentation/feature-removal-schedule.txt.
  1170. Caveat: when a parent task is selected, the oom killer will sacrifice any first
  1171. generation children with separate address spaces instead, if possible. This
  1172. avoids servers and important system daemons from being killed and loses the
  1173. minimal amount of work.
  1174. 3.2 /proc/<pid>/oom_score - Display current oom-killer score
  1175. -------------------------------------------------------------
  1176. This file can be used to check the current score used by the oom-killer is for
  1177. any given <pid>. Use it together with /proc/<pid>/oom_adj to tune which
  1178. process should be killed in an out-of-memory situation.
  1179. 3.3 /proc/<pid>/io - Display the IO accounting fields
  1180. -------------------------------------------------------
  1181. This file contains IO statistics for each running process
  1182. Example
  1183. -------
  1184. test:/tmp # dd if=/dev/zero of=/tmp/test.dat &
  1185. [1] 3828
  1186. test:/tmp # cat /proc/3828/io
  1187. rchar: 323934931
  1188. wchar: 323929600
  1189. syscr: 632687
  1190. syscw: 632675
  1191. read_bytes: 0
  1192. write_bytes: 323932160
  1193. cancelled_write_bytes: 0
  1194. Description
  1195. -----------
  1196. rchar
  1197. -----
  1198. I/O counter: chars read
  1199. The number of bytes which this task has caused to be read from storage. This
  1200. is simply the sum of bytes which this process passed to read() and pread().
  1201. It includes things like tty IO and it is unaffected by whether or not actual
  1202. physical disk IO was required (the read might have been satisfied from
  1203. pagecache)
  1204. wchar
  1205. -----
  1206. I/O counter: chars written
  1207. The number of bytes which this task has caused, or shall cause to be written
  1208. to disk. Similar caveats apply here as with rchar.
  1209. syscr
  1210. -----
  1211. I/O counter: read syscalls
  1212. Attempt to count the number of read I/O operations, i.e. syscalls like read()
  1213. and pread().
  1214. syscw
  1215. -----
  1216. I/O counter: write syscalls
  1217. Attempt to count the number of write I/O operations, i.e. syscalls like
  1218. write() and pwrite().
  1219. read_bytes
  1220. ----------
  1221. I/O counter: bytes read
  1222. Attempt to count the number of bytes which this process really did cause to
  1223. be fetched from the storage layer. Done at the submit_bio() level, so it is
  1224. accurate for block-backed filesystems. <please add status regarding NFS and
  1225. CIFS at a later time>
  1226. write_bytes
  1227. -----------
  1228. I/O counter: bytes written
  1229. Attempt to count the number of bytes which this process caused to be sent to
  1230. the storage layer. This is done at page-dirtying time.
  1231. cancelled_write_bytes
  1232. ---------------------
  1233. The big inaccuracy here is truncate. If a process writes 1MB to a file and
  1234. then deletes the file, it will in fact perform no writeout. But it will have
  1235. been accounted as having caused 1MB of write.
  1236. In other words: The number of bytes which this process caused to not happen,
  1237. by truncating pagecache. A task can cause "negative" IO too. If this task
  1238. truncates some dirty pagecache, some IO which another task has been accounted
  1239. for (in its write_bytes) will not be happening. We _could_ just subtract that
  1240. from the truncating task's write_bytes, but there is information loss in doing
  1241. that.
  1242. Note
  1243. ----
  1244. At its current implementation state, this is a bit racy on 32-bit machines: if
  1245. process A reads process B's /proc/pid/io while process B is updating one of
  1246. those 64-bit counters, process A could see an intermediate result.
  1247. More information about this can be found within the taskstats documentation in
  1248. Documentation/accounting.
  1249. 3.4 /proc/<pid>/coredump_filter - Core dump filtering settings
  1250. ---------------------------------------------------------------
  1251. When a process is dumped, all anonymous memory is written to a core file as
  1252. long as the size of the core file isn't limited. But sometimes we don't want
  1253. to dump some memory segments, for example, huge shared memory. Conversely,
  1254. sometimes we want to save file-backed memory segments into a core file, not
  1255. only the individual files.
  1256. /proc/<pid>/coredump_filter allows you to customize which memory segments
  1257. will be dumped when the <pid> process is dumped. coredump_filter is a bitmask
  1258. of memory types. If a bit of the bitmask is set, memory segments of the
  1259. corresponding memory type are dumped, otherwise they are not dumped.
  1260. The following 7 memory types are supported:
  1261. - (bit 0) anonymous private memory
  1262. - (bit 1) anonymous shared memory
  1263. - (bit 2) file-backed private memory
  1264. - (bit 3) file-backed shared memory
  1265. - (bit 4) ELF header pages in file-backed private memory areas (it is
  1266. effective only if the bit 2 is cleared)
  1267. - (bit 5) hugetlb private memory
  1268. - (bit 6) hugetlb shared memory
  1269. Note that MMIO pages such as frame buffer are never dumped and vDSO pages
  1270. are always dumped regardless of the bitmask status.
  1271. Note bit 0-4 doesn't effect any hugetlb memory. hugetlb memory are only
  1272. effected by bit 5-6.
  1273. Default value of coredump_filter is 0x23; this means all anonymous memory
  1274. segments and hugetlb private memory are dumped.
  1275. If you don't want to dump all shared memory segments attached to pid 1234,
  1276. write 0x21 to the process's proc file.
  1277. $ echo 0x21 > /proc/1234/coredump_filter
  1278. When a new process is created, the process inherits the bitmask status from its
  1279. parent. It is useful to set up coredump_filter before the program runs.
  1280. For example:
  1281. $ echo 0x7 > /proc/self/coredump_filter
  1282. $ ./some_program
  1283. 3.5 /proc/<pid>/mountinfo - Information about mounts
  1284. --------------------------------------------------------
  1285. This file contains lines of the form:
  1286. 36 35 98:0 /mnt1 /mnt2 rw,noatime master:1 - ext3 /dev/root rw,errors=continue
  1287. (1)(2)(3) (4) (5) (6) (7) (8) (9) (10) (11)
  1288. (1) mount ID: unique identifier of the mount (may be reused after umount)
  1289. (2) parent ID: ID of parent (or of self for the top of the mount tree)
  1290. (3) major:minor: value of st_dev for files on filesystem
  1291. (4) root: root of the mount within the filesystem
  1292. (5) mount point: mount point relative to the process's root
  1293. (6) mount options: per mount options
  1294. (7) optional fields: zero or more fields of the form "tag[:value]"
  1295. (8) separator: marks the end of the optional fields
  1296. (9) filesystem type: name of filesystem of the form "type[.subtype]"
  1297. (10) mount source: filesystem specific information or "none"
  1298. (11) super options: per super block options
  1299. Parsers should ignore all unrecognised optional fields. Currently the
  1300. possible optional fields are:
  1301. shared:X mount is shared in peer group X
  1302. master:X mount is slave to peer group X
  1303. propagate_from:X mount is slave and receives propagation from peer group X (*)
  1304. unbindable mount is unbindable
  1305. (*) X is the closest dominant peer group under the process's root. If
  1306. X is the immediate master of the mount, or if there's no dominant peer
  1307. group under the same root, then only the "master:X" field is present
  1308. and not the "propagate_from:X" field.
  1309. For more information on mount propagation see:
  1310. Documentation/filesystems/sharedsubtree.txt
  1311. 3.6 /proc/<pid>/comm & /proc/<pid>/task/<tid>/comm
  1312. --------------------------------------------------------
  1313. These files provide a method to access a tasks comm value. It also allows for
  1314. a task to set its own or one of its thread siblings comm value. The comm value
  1315. is limited in size compared to the cmdline value, so writing anything longer
  1316. then the kernel's TASK_COMM_LEN (currently 16 chars) will result in a truncated
  1317. comm value.
  1318. ------------------------------------------------------------------------------
  1319. Configuring procfs
  1320. ------------------------------------------------------------------------------
  1321. 4.1 Mount options
  1322. ---------------------
  1323. The following mount options are supported:
  1324. hidepid= Set /proc/<pid>/ access mode.
  1325. gid= Set the group authorized to learn processes information.
  1326. hidepid=0 means classic mode - everybody may access all /proc/<pid>/ directories
  1327. (default).
  1328. hidepid=1 means users may not access any /proc/<pid>/ directories but their
  1329. own. Sensitive files like cmdline, sched*, status are now protected against
  1330. other users. This makes it impossible to learn whether any user runs
  1331. specific program (given the program doesn't reveal itself by its behaviour).
  1332. As an additional bonus, as /proc/<pid>/cmdline is unaccessible for other users,
  1333. poorly written programs passing sensitive information via program arguments are
  1334. now protected against local eavesdroppers.
  1335. hidepid=2 means hidepid=1 plus all /proc/<pid>/ will be fully invisible to other
  1336. users. It doesn't mean that it hides a fact whether a process with a specific
  1337. pid value exists (it can be learned by other means, e.g. by "kill -0 $PID"),
  1338. but it hides process' uid and gid, which may be learned by stat()'ing
  1339. /proc/<pid>/ otherwise. It greatly complicates an intruder's task of gathering
  1340. information about running processes, whether some daemon runs with elevated
  1341. privileges, whether other user runs some sensitive program, whether other users
  1342. run any program at all, etc.
  1343. gid= defines a group authorized to learn processes information otherwise
  1344. prohibited by hidepid=. If you use some daemon like identd which needs to learn
  1345. information about processes information, just add identd to this group.