The 78 Billion Line Text File
2 Answers Use shuf with the -n option as shown below, to get N random lines: shuf -N input > output This should be the accepted answer. Wow, shuf is soooo fast. - picking 10000 random lines from a textfile with 40000 lines is instant. Trying to use 'sort -R' took so long I just 'CTRL-C' it If you just need a random set of lines, not in a random order, then shuf is very inefficient (or big file): better is to do reservoir sampling, as in this answer. neither shuf nor sort -R are available for mac OSX. any suggestions? – @TomSmith On Mac OSX, if you are using Homebrew, you can get shuf or GNU sort by installing coreutils. More info here: apple.stackexchange.com/questions/142860/install-shuf-on-os-x shuf is fantastic. I tried in on a 78 Billion line text file and it did the job in less than 1 minute. a 78 Billion line text file a The WHAT
На скриншоте обсуждение команды shuf, которая быстро обрабатывает 78-миллиардный текстовый файл, а внизу показана улыбающаяся девочка с подписями «The» и «WHAT». Шутка строится на абсурдно огромном размере файла и ошеломлённой реакции на то, что задача выполнилась почти мгновенно. EN: The screenshot shows a discussion about the shuf command quickly processing a 78-billion-line text file, followed by a smiling girl labeled “The” and “WHAT.” The joke comes from the absurdly huge file size and the stunned reaction to the task finishing almost instantly.
computer screen / экран компьютераStack Overflow page / страница Stack Overflowtext file / текстовый файлcode snippet / фрагмент кодаlarge black text / крупный чёрный текстsmiling girl / улыбающаяся девочкаwhite shirt / белая рубашкаred background / красный фонteeth / зубыclose-up face / крупный план лица
- @dev_meme / 1633 2020-05-27
- @gentoomemes / 19063 2025-10-27
- Type
- image
- Size
- 601×800 · 95.2 KiB
- Mood
- absurd, shocked
- Language
- en
- Added
