Grepping string, but include all non-blank lines following each grep match2019 Community Moderator ElectionHow can I grep a directory based on the contents of two successive lines?grep: Find all lines that contain Japanese kanjisBlank lines when executing “grep | xargs” in a “find -exec”How to use grep/awk/unix to match all lines from one file in another file, even if they are duplicatesRemove all the lines before the first line that contains a match?grep match all occurrences of multiple regular expressionsCompare two files and retrieve corresponding resultsregex and grep: match all letters in a listHow to search for a match, then a non-match on that line, but include context lines for matched line?How to `grep -v` and also exclude 'n' lines after the match?

Why does Carol not get rid of the Kree symbol on her suit when she changes its colours?

Multiplicative persistence

Why does the Sun have different day lengths, but not the gas giants?

Is there any evidence that Cleopatra and Caesarion considered fleeing to India to escape the Romans?

What fields between the rationals and the reals allow a good notion of 2D distance?

Why do ¬, ∀ and ∃ have the same precedence?

What kind of floor tile is this?

Are Captain Marvel's powers affected by Thanos breaking the Tesseract and claiming the stone?

Has any country ever had 2 former presidents in jail simultaneously?

Doesn't the system of the Supreme Court oppose justice?

C++ copy constructor called at return

Why is the "ls" command showing permissions of files in a FAT32 partition?

Did the UK lift the requirement for registering SIM cards?

Why is it that I can sometimes guess the next note?

A variation to the phrase "hanging over my shoulders"

Is this part of the description of the Archfey warlock's Misty Escape feature redundant?

Strong empirical falsification of quantum mechanics based on vacuum energy density?

Will number of steps recorded on FitBit/any fitness tracker add up distance in PokemonGo?

Why can't the Brexit deadlock in the UK parliament be solved with a plurality vote?

Review your own paper in Mathematics

Microchip documentation does not label CAN buss pins on micro controller pinout diagram

I found an audio circuit and I built it just fine, but I find it a bit too quiet. How do I amplify the output so that it is a bit louder?

Why does AES have exactly 10 rounds for a 128-bit key, 12 for 192 bits and 14 for a 256-bit key size?

Pre-mixing cryogenic fuels and using only one fuel tank



Grepping string, but include all non-blank lines following each grep match



2019 Community Moderator ElectionHow can I grep a directory based on the contents of two successive lines?grep: Find all lines that contain Japanese kanjisBlank lines when executing “grep | xargs” in a “find -exec”How to use grep/awk/unix to match all lines from one file in another file, even if they are duplicatesRemove all the lines before the first line that contains a match?grep match all occurrences of multiple regular expressionsCompare two files and retrieve corresponding resultsregex and grep: match all letters in a listHow to search for a match, then a non-match on that line, but include context lines for matched line?How to `grep -v` and also exclude 'n' lines after the match?










7















Consider the following toy example:



this is a line 
this line contains FOO
this line is not blank

This line also contains FOO

Some random text

This line contains FOO too
Not blank
Also not blank

More random text
FOO!
Yet more random text
FOO!


So, I want the results of a grep for FOO, but with the extra wrinkle that lines following the matching lines should be included, as long as they are not blank, and they do not themselves contain FOO. So the matches would look as follows, with the different matches separated:



MATCH 1



this line contains FOO 
this line is not blank


MATCH 2



This line also contains FOO


MATCH 3



This line contains FOO too 
Not blank
Also not blank


MATCH 4



FOO!
Yet more random text


MATCH 5



FOO!


Bonus points (metaphorically speaking) for a simple single line script that can be run on the command line.



ADDENDUM: Adding a running count of the match number would be quite handy, if it is not too hard.










share|improve this question



















  • 2





    do you want all the Matches in one output or you want them to be ran separately ?

    – Vivek Kanadiya
    yesterday











  • I guess one output is fine, as long as they are clearly separated, say by a blank line.

    – Faheem Mitha
    yesterday











  • might not possible in one output but I can try to see in each separate output!

    – Vivek Kanadiya
    yesterday











  • For matches 4 & 5, the simple logic could say "I've matched (the 4th) "FOO", so I should continue printing in this matching block until I see a blank line, and so the final "FOO" is included in this block", but i see you've separated it -- because it's a separate "FOO" match. Do you require the 5th "FOO" to be printed separately?

    – Jeff Schaller
    yesterday











  • @JeffSchaller Yes, please separate different FOO matches.

    – Faheem Mitha
    yesterday















7















Consider the following toy example:



this is a line 
this line contains FOO
this line is not blank

This line also contains FOO

Some random text

This line contains FOO too
Not blank
Also not blank

More random text
FOO!
Yet more random text
FOO!


So, I want the results of a grep for FOO, but with the extra wrinkle that lines following the matching lines should be included, as long as they are not blank, and they do not themselves contain FOO. So the matches would look as follows, with the different matches separated:



MATCH 1



this line contains FOO 
this line is not blank


MATCH 2



This line also contains FOO


MATCH 3



This line contains FOO too 
Not blank
Also not blank


MATCH 4



FOO!
Yet more random text


MATCH 5



FOO!


Bonus points (metaphorically speaking) for a simple single line script that can be run on the command line.



ADDENDUM: Adding a running count of the match number would be quite handy, if it is not too hard.










share|improve this question



















  • 2





    do you want all the Matches in one output or you want them to be ran separately ?

    – Vivek Kanadiya
    yesterday











  • I guess one output is fine, as long as they are clearly separated, say by a blank line.

    – Faheem Mitha
    yesterday











  • might not possible in one output but I can try to see in each separate output!

    – Vivek Kanadiya
    yesterday











  • For matches 4 & 5, the simple logic could say "I've matched (the 4th) "FOO", so I should continue printing in this matching block until I see a blank line, and so the final "FOO" is included in this block", but i see you've separated it -- because it's a separate "FOO" match. Do you require the 5th "FOO" to be printed separately?

    – Jeff Schaller
    yesterday











  • @JeffSchaller Yes, please separate different FOO matches.

    – Faheem Mitha
    yesterday













7












7








7








Consider the following toy example:



this is a line 
this line contains FOO
this line is not blank

This line also contains FOO

Some random text

This line contains FOO too
Not blank
Also not blank

More random text
FOO!
Yet more random text
FOO!


So, I want the results of a grep for FOO, but with the extra wrinkle that lines following the matching lines should be included, as long as they are not blank, and they do not themselves contain FOO. So the matches would look as follows, with the different matches separated:



MATCH 1



this line contains FOO 
this line is not blank


MATCH 2



This line also contains FOO


MATCH 3



This line contains FOO too 
Not blank
Also not blank


MATCH 4



FOO!
Yet more random text


MATCH 5



FOO!


Bonus points (metaphorically speaking) for a simple single line script that can be run on the command line.



ADDENDUM: Adding a running count of the match number would be quite handy, if it is not too hard.










share|improve this question
















Consider the following toy example:



this is a line 
this line contains FOO
this line is not blank

This line also contains FOO

Some random text

This line contains FOO too
Not blank
Also not blank

More random text
FOO!
Yet more random text
FOO!


So, I want the results of a grep for FOO, but with the extra wrinkle that lines following the matching lines should be included, as long as they are not blank, and they do not themselves contain FOO. So the matches would look as follows, with the different matches separated:



MATCH 1



this line contains FOO 
this line is not blank


MATCH 2



This line also contains FOO


MATCH 3



This line contains FOO too 
Not blank
Also not blank


MATCH 4



FOO!
Yet more random text


MATCH 5



FOO!


Bonus points (metaphorically speaking) for a simple single line script that can be run on the command line.



ADDENDUM: Adding a running count of the match number would be quite handy, if it is not too hard.







text-processing grep






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited yesterday







Faheem Mitha

















asked yesterday









Faheem MithaFaheem Mitha

23.2k1884137




23.2k1884137







  • 2





    do you want all the Matches in one output or you want them to be ran separately ?

    – Vivek Kanadiya
    yesterday











  • I guess one output is fine, as long as they are clearly separated, say by a blank line.

    – Faheem Mitha
    yesterday











  • might not possible in one output but I can try to see in each separate output!

    – Vivek Kanadiya
    yesterday











  • For matches 4 & 5, the simple logic could say "I've matched (the 4th) "FOO", so I should continue printing in this matching block until I see a blank line, and so the final "FOO" is included in this block", but i see you've separated it -- because it's a separate "FOO" match. Do you require the 5th "FOO" to be printed separately?

    – Jeff Schaller
    yesterday











  • @JeffSchaller Yes, please separate different FOO matches.

    – Faheem Mitha
    yesterday












  • 2





    do you want all the Matches in one output or you want them to be ran separately ?

    – Vivek Kanadiya
    yesterday











  • I guess one output is fine, as long as they are clearly separated, say by a blank line.

    – Faheem Mitha
    yesterday











  • might not possible in one output but I can try to see in each separate output!

    – Vivek Kanadiya
    yesterday











  • For matches 4 & 5, the simple logic could say "I've matched (the 4th) "FOO", so I should continue printing in this matching block until I see a blank line, and so the final "FOO" is included in this block", but i see you've separated it -- because it's a separate "FOO" match. Do you require the 5th "FOO" to be printed separately?

    – Jeff Schaller
    yesterday











  • @JeffSchaller Yes, please separate different FOO matches.

    – Faheem Mitha
    yesterday







2




2





do you want all the Matches in one output or you want them to be ran separately ?

– Vivek Kanadiya
yesterday





do you want all the Matches in one output or you want them to be ran separately ?

– Vivek Kanadiya
yesterday













I guess one output is fine, as long as they are clearly separated, say by a blank line.

– Faheem Mitha
yesterday





I guess one output is fine, as long as they are clearly separated, say by a blank line.

– Faheem Mitha
yesterday













might not possible in one output but I can try to see in each separate output!

– Vivek Kanadiya
yesterday





might not possible in one output but I can try to see in each separate output!

– Vivek Kanadiya
yesterday













For matches 4 & 5, the simple logic could say "I've matched (the 4th) "FOO", so I should continue printing in this matching block until I see a blank line, and so the final "FOO" is included in this block", but i see you've separated it -- because it's a separate "FOO" match. Do you require the 5th "FOO" to be printed separately?

– Jeff Schaller
yesterday





For matches 4 & 5, the simple logic could say "I've matched (the 4th) "FOO", so I should continue printing in this matching block until I see a blank line, and so the final "FOO" is included in this block", but i see you've separated it -- because it's a separate "FOO" match. Do you require the 5th "FOO" to be printed separately?

– Jeff Schaller
yesterday













@JeffSchaller Yes, please separate different FOO matches.

– Faheem Mitha
yesterday





@JeffSchaller Yes, please separate different FOO matches.

– Faheem Mitha
yesterday










7 Answers
7






active

oldest

votes


















9














Using awk rather than grep:



awk '/FOO/ if (matching) printf("n"); matching = 1 
/^$/ if (matching) printf("n"); matching = 0
matching' file


A version that enumerates the matches:



awk 'function flush_print_maybe() 
if (matching) printf("Match %dn%snn", ++n, buf)
buf = ""

/FOO/ flush_print_maybe(); matching = 1
/^$/ flush_print_maybe(); matching = 0
matching buf = (buf == "" ? $0 : buf ORS $0)
END flush_print_maybe() ' file


Both awk programs uses a very simple "state machine" to determine if it's currently matching or not matching. A match of the pattern FOO will cause it to enter the matching state, and a match of the pattern ^$ (an empty line) will cause it to enter the non-matching state.



Output of empty lines between matching sets of data happens at state transitions from matching (either into matching or into non-matching).



The first program prints any line when in the matching state.



The second program collects lines in a buf variable when in a matching state. It flushes (empties) this after possibly printing it (depending on the state), together with a Match N label at state transitions (when the first program would output an empty line).



Output of this last program on the sample data:



Match 1
this line contains FOO
this line is not blank

Match 2
This line also contains FOO

Match 3
This line contains FOO too
Not blank
Also not blank

Match 4
FOO!
Yet more random text

Match 5
FOO!





share|improve this answer

























  • Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

    – Stephen Kitt
    yesterday











  • @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

    – Kusalananda
    yesterday












  • Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

    – Stephen Kitt
    yesterday











  • @StephenKitt It's almost midnight here, I'll get back to it later. :-)

    – Kusalananda
    yesterday


















6














sed -ne '/FOO/x;P;x;/FOO/,/^$/p' testfile


Each block of non-empty lines in the output is a single chunk of matched data from the input. The number of newlines varies.



This



  1. suppresses output (-n); then

  2. prints a blank line before every occurrence of "FOO" (/FOO/x;P;x - uses the empty hold space);

  3. selects ranges of lines starting from ones containing FOO (/FOO/) and ending on empty lines (/^$/); and finally

  4. prints those lines (p).


this line contains FOO
this line is not blank


This line also contains FOO


This line contains FOO too
Not blank
Also not blank


FOO!
Yet more random text

FOO!





share|improve this answer
































    5














    I don’t think this is doable with grep, but it is with AWK:



    #! /usr/bin/awk -f

    /FOO/
    matched = 1
    if (notfirst) print ""
    notfirst = 1


    /^$/
    matched = 0


    matched


    With a count of matches:



    #! /usr/bin/awk -f

    /FOO/
    matched = 1
    if (matches) print ""
    printf "Match %dn", ++matches


    /^$/
    matched = 0


    matched


    In both cases, the first two blocks determine whether the current record should be copied to the output. When the current record matches “FOO”, the first block sets matched to 1, outputs a blank record if necessary (to separate the forthcoming output from the previous match); in the second variant, it also increments the matches counter and outputs a header. When the current record is empty, the second block sets matched to 0. The lonely matched condition prints the current record if matched is 1.






    share|improve this answer
































      2














      I've included a pcregrep solution and a python solution.



      Multiline Grep Solution



      If you have pcregrep installed, you could use a multiline pattern, such as ^.*FOO.*$n?(^.*S.*$n?)*, e.g.:



      pcregrep -M '^.*FOO.*$n?(^.*S.*$n?)*' test.txt


      The subexpression ^.*FOO.*$n? will match any line containing the string FOO and the subexpression (^.*S.*$n?)* will match any number of subsequent lines that containing a non-whitespace character.



      Python Solution



      Here is a Python script that should do what you want:



      #!/usr/bin/env python3
      # -*- encoding: utf8 -*-
      """grep_follow.py

      Search a text file for a pattern,
      and output that pattern and the
      non-empty lines which immediately follow it.
      """

      import re
      import sys

      # Get the search pattern and the input file as command-line arguments
      pattern = sys.argv[1]
      input_file = sys.argv[2]

      # Set a flag to determine whether or not to output the current line
      print_flag = False

      with open(input_file, "r") as _input_file:

      # Iterate over the lines of the input file
      for line in _input_file:

      # Remove trailing whitespace
      line = line.rstrip()

      # If the line is empty, stop producing output
      if not line.strip():
      print_flag = False

      # If the line matches the search pattern, start producing output
      elif re.search(pattern, line):
      print_flag = True

      # If the print flag is set then output the line
      if print_flag:
      print(line)


      You would run it like this:



      $ python grep_follow.py FOO test.txt


      this line contains FOO
      this line is not blank
      This line also contains FOO
      This line contains FOO too
      Not blank
      Also not blank
      FOO!
      Yet more random text
      FOO!





      share|improve this answer




















      • 1





        a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

        – iruvar
        yesterday


















      1














      awk '/FOO/print "===match " ++i "===" /FOO/,/^$/' file

      ===match 1===
      this line contains FOO
      this line is not blank

      ===match 2===
      This line also contains FOO

      ===match 3===
      This line contains FOO too
      Not blank
      Also not blank

      ===match 4===
      FOO!
      Yet more random text
      ===match 5===
      FOO!


      A similar variant where FOO could be easily changed to something else:



      awk -vpat=FOO '$0~patprint "===match " ++i "===" $0~pat,/^$/' file


      Omitting the terminating empty line from the default print is left as an exercise to the reader ;-)






      share|improve this answer






























        0














        One way can be using Perl's range operator ...:



        $ perl -lne '
        print s|^(?=.*FOO)|$/."MATCH#".++$c.$/|re if /FOO/ ... /^$/;
        ' input.txt

        MATCH#1
        this line contains FOO
        this line is not blank


        MATCH#2
        This line also contains FOO


        MATCH#3
        This line contains FOO too
        Not blank
        Also not blank


        MATCH#4
        FOO!
        Yet more random text

        MATCH#5
        FOO!


        In case the extra blank lines are an issue, you can use the below code, where make use of the range operator in scalar context in order to have a peek into the state machine values and perform actions based on them.



        Note :



        $/ = RS = "n"



        $, = OFS = ""



        $ perl -lne '
        print
        s^(?=.*FOO)

        ($,,$/)[$r>1] .
        "MATCH#" . ++$count . $/
        rex
        if $r = /FOO/ ... /^$/;
        ' input.txt


        Here's another method to tackle the pbm, this time using the paragraph mode of Perl. We read in records a para at a time and split them on newlines into fields.



        Then we make sure to handle only those paras that happen to have the string foo in them. Finally, we print the fields with the constraint on foo-containing fields being treated specially. Even here we deal with the first field differently than the rest.



        $ perl -aln -F'n' -00 -e '
        next unless /FOO/;
        shift @F until $F[0] =~ /FOO/;
        push @F, $, if ! eof;
        print "MATCH#", ++$k, $, shift @F;
        print for map /FOO/ and $_ = "nMATCH#" . ++$k . "n$_";$_ @F;
        ' input.txt





        share|improve this answer
































          0














          Here is a one-liner that may not exactly match the criteria, but comes close enough for most purposes.



          gawk '/FOO/p=1 if(p) print /^$/p=0' infile.txt


          First rule sets p=1 if it sees FOO. Second rule prints the current line if p is not zero. Third rule sets p=0 if the line (already printed) is blank. Swap second and third rules if you do not want the blank line terminator to be output.



          This is a variant which numbers and separates the matches if there are multiple FOO instances not separated by blank lines



          gawk '/FOO/p=1; n++; print "n" n /^$/p=0 //if (p) print $0 ' infile.txt





          share|improve this answer






















            Your Answer








            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "106"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: false,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: null,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f507517%2fgrepping-string-but-include-all-non-blank-lines-following-each-grep-match%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            7 Answers
            7






            active

            oldest

            votes








            7 Answers
            7






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            9














            Using awk rather than grep:



            awk '/FOO/ if (matching) printf("n"); matching = 1 
            /^$/ if (matching) printf("n"); matching = 0
            matching' file


            A version that enumerates the matches:



            awk 'function flush_print_maybe() 
            if (matching) printf("Match %dn%snn", ++n, buf)
            buf = ""

            /FOO/ flush_print_maybe(); matching = 1
            /^$/ flush_print_maybe(); matching = 0
            matching buf = (buf == "" ? $0 : buf ORS $0)
            END flush_print_maybe() ' file


            Both awk programs uses a very simple "state machine" to determine if it's currently matching or not matching. A match of the pattern FOO will cause it to enter the matching state, and a match of the pattern ^$ (an empty line) will cause it to enter the non-matching state.



            Output of empty lines between matching sets of data happens at state transitions from matching (either into matching or into non-matching).



            The first program prints any line when in the matching state.



            The second program collects lines in a buf variable when in a matching state. It flushes (empties) this after possibly printing it (depending on the state), together with a Match N label at state transitions (when the first program would output an empty line).



            Output of this last program on the sample data:



            Match 1
            this line contains FOO
            this line is not blank

            Match 2
            This line also contains FOO

            Match 3
            This line contains FOO too
            Not blank
            Also not blank

            Match 4
            FOO!
            Yet more random text

            Match 5
            FOO!





            share|improve this answer

























            • Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

              – Stephen Kitt
              yesterday











            • @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

              – Kusalananda
              yesterday












            • Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

              – Stephen Kitt
              yesterday











            • @StephenKitt It's almost midnight here, I'll get back to it later. :-)

              – Kusalananda
              yesterday















            9














            Using awk rather than grep:



            awk '/FOO/ if (matching) printf("n"); matching = 1 
            /^$/ if (matching) printf("n"); matching = 0
            matching' file


            A version that enumerates the matches:



            awk 'function flush_print_maybe() 
            if (matching) printf("Match %dn%snn", ++n, buf)
            buf = ""

            /FOO/ flush_print_maybe(); matching = 1
            /^$/ flush_print_maybe(); matching = 0
            matching buf = (buf == "" ? $0 : buf ORS $0)
            END flush_print_maybe() ' file


            Both awk programs uses a very simple "state machine" to determine if it's currently matching or not matching. A match of the pattern FOO will cause it to enter the matching state, and a match of the pattern ^$ (an empty line) will cause it to enter the non-matching state.



            Output of empty lines between matching sets of data happens at state transitions from matching (either into matching or into non-matching).



            The first program prints any line when in the matching state.



            The second program collects lines in a buf variable when in a matching state. It flushes (empties) this after possibly printing it (depending on the state), together with a Match N label at state transitions (when the first program would output an empty line).



            Output of this last program on the sample data:



            Match 1
            this line contains FOO
            this line is not blank

            Match 2
            This line also contains FOO

            Match 3
            This line contains FOO too
            Not blank
            Also not blank

            Match 4
            FOO!
            Yet more random text

            Match 5
            FOO!





            share|improve this answer

























            • Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

              – Stephen Kitt
              yesterday











            • @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

              – Kusalananda
              yesterday












            • Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

              – Stephen Kitt
              yesterday











            • @StephenKitt It's almost midnight here, I'll get back to it later. :-)

              – Kusalananda
              yesterday













            9












            9








            9







            Using awk rather than grep:



            awk '/FOO/ if (matching) printf("n"); matching = 1 
            /^$/ if (matching) printf("n"); matching = 0
            matching' file


            A version that enumerates the matches:



            awk 'function flush_print_maybe() 
            if (matching) printf("Match %dn%snn", ++n, buf)
            buf = ""

            /FOO/ flush_print_maybe(); matching = 1
            /^$/ flush_print_maybe(); matching = 0
            matching buf = (buf == "" ? $0 : buf ORS $0)
            END flush_print_maybe() ' file


            Both awk programs uses a very simple "state machine" to determine if it's currently matching or not matching. A match of the pattern FOO will cause it to enter the matching state, and a match of the pattern ^$ (an empty line) will cause it to enter the non-matching state.



            Output of empty lines between matching sets of data happens at state transitions from matching (either into matching or into non-matching).



            The first program prints any line when in the matching state.



            The second program collects lines in a buf variable when in a matching state. It flushes (empties) this after possibly printing it (depending on the state), together with a Match N label at state transitions (when the first program would output an empty line).



            Output of this last program on the sample data:



            Match 1
            this line contains FOO
            this line is not blank

            Match 2
            This line also contains FOO

            Match 3
            This line contains FOO too
            Not blank
            Also not blank

            Match 4
            FOO!
            Yet more random text

            Match 5
            FOO!





            share|improve this answer















            Using awk rather than grep:



            awk '/FOO/ if (matching) printf("n"); matching = 1 
            /^$/ if (matching) printf("n"); matching = 0
            matching' file


            A version that enumerates the matches:



            awk 'function flush_print_maybe() 
            if (matching) printf("Match %dn%snn", ++n, buf)
            buf = ""

            /FOO/ flush_print_maybe(); matching = 1
            /^$/ flush_print_maybe(); matching = 0
            matching buf = (buf == "" ? $0 : buf ORS $0)
            END flush_print_maybe() ' file


            Both awk programs uses a very simple "state machine" to determine if it's currently matching or not matching. A match of the pattern FOO will cause it to enter the matching state, and a match of the pattern ^$ (an empty line) will cause it to enter the non-matching state.



            Output of empty lines between matching sets of data happens at state transitions from matching (either into matching or into non-matching).



            The first program prints any line when in the matching state.



            The second program collects lines in a buf variable when in a matching state. It flushes (empties) this after possibly printing it (depending on the state), together with a Match N label at state transitions (when the first program would output an empty line).



            Output of this last program on the sample data:



            Match 1
            this line contains FOO
            this line is not blank

            Match 2
            This line also contains FOO

            Match 3
            This line contains FOO too
            Not blank
            Also not blank

            Match 4
            FOO!
            Yet more random text

            Match 5
            FOO!






            share|improve this answer














            share|improve this answer



            share|improve this answer








            edited yesterday

























            answered yesterday









            KusalanandaKusalananda

            137k17258426




            137k17258426












            • Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

              – Stephen Kitt
              yesterday











            • @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

              – Kusalananda
              yesterday












            • Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

              – Stephen Kitt
              yesterday











            • @StephenKitt It's almost midnight here, I'll get back to it later. :-)

              – Kusalananda
              yesterday

















            • Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

              – Stephen Kitt
              yesterday











            • @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

              – Kusalananda
              yesterday












            • Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

              – Stephen Kitt
              yesterday











            • @StephenKitt It's almost midnight here, I'll get back to it later. :-)

              – Kusalananda
              yesterday
















            Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

            – Stephen Kitt
            yesterday





            Nitpicking, these output an extra blank line if there’s a non-matching section at the end of the input ;-).

            – Stephen Kitt
            yesterday













            @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

            – Kusalananda
            yesterday






            @StephenKitt Yes. It will. Each result block will be terminated by an empty line.

            – Kusalananda
            yesterday














            Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

            – Stephen Kitt
            yesterday





            Only if there’s an empty line following the result block (so the example text in the question doesn’t cause an empty line to be printed at the end).

            – Stephen Kitt
            yesterday













            @StephenKitt It's almost midnight here, I'll get back to it later. :-)

            – Kusalananda
            yesterday





            @StephenKitt It's almost midnight here, I'll get back to it later. :-)

            – Kusalananda
            yesterday













            6














            sed -ne '/FOO/x;P;x;/FOO/,/^$/p' testfile


            Each block of non-empty lines in the output is a single chunk of matched data from the input. The number of newlines varies.



            This



            1. suppresses output (-n); then

            2. prints a blank line before every occurrence of "FOO" (/FOO/x;P;x - uses the empty hold space);

            3. selects ranges of lines starting from ones containing FOO (/FOO/) and ending on empty lines (/^$/); and finally

            4. prints those lines (p).


            this line contains FOO
            this line is not blank


            This line also contains FOO


            This line contains FOO too
            Not blank
            Also not blank


            FOO!
            Yet more random text

            FOO!





            share|improve this answer





























              6














              sed -ne '/FOO/x;P;x;/FOO/,/^$/p' testfile


              Each block of non-empty lines in the output is a single chunk of matched data from the input. The number of newlines varies.



              This



              1. suppresses output (-n); then

              2. prints a blank line before every occurrence of "FOO" (/FOO/x;P;x - uses the empty hold space);

              3. selects ranges of lines starting from ones containing FOO (/FOO/) and ending on empty lines (/^$/); and finally

              4. prints those lines (p).


              this line contains FOO
              this line is not blank


              This line also contains FOO


              This line contains FOO too
              Not blank
              Also not blank


              FOO!
              Yet more random text

              FOO!





              share|improve this answer



























                6












                6








                6







                sed -ne '/FOO/x;P;x;/FOO/,/^$/p' testfile


                Each block of non-empty lines in the output is a single chunk of matched data from the input. The number of newlines varies.



                This



                1. suppresses output (-n); then

                2. prints a blank line before every occurrence of "FOO" (/FOO/x;P;x - uses the empty hold space);

                3. selects ranges of lines starting from ones containing FOO (/FOO/) and ending on empty lines (/^$/); and finally

                4. prints those lines (p).


                this line contains FOO
                this line is not blank


                This line also contains FOO


                This line contains FOO too
                Not blank
                Also not blank


                FOO!
                Yet more random text

                FOO!





                share|improve this answer















                sed -ne '/FOO/x;P;x;/FOO/,/^$/p' testfile


                Each block of non-empty lines in the output is a single chunk of matched data from the input. The number of newlines varies.



                This



                1. suppresses output (-n); then

                2. prints a blank line before every occurrence of "FOO" (/FOO/x;P;x - uses the empty hold space);

                3. selects ranges of lines starting from ones containing FOO (/FOO/) and ending on empty lines (/^$/); and finally

                4. prints those lines (p).


                this line contains FOO
                this line is not blank


                This line also contains FOO


                This line contains FOO too
                Not blank
                Also not blank


                FOO!
                Yet more random text

                FOO!






                share|improve this answer














                share|improve this answer



                share|improve this answer








                edited yesterday

























                answered yesterday









                Michael HomerMichael Homer

                50k8137175




                50k8137175





















                    5














                    I don’t think this is doable with grep, but it is with AWK:



                    #! /usr/bin/awk -f

                    /FOO/
                    matched = 1
                    if (notfirst) print ""
                    notfirst = 1


                    /^$/
                    matched = 0


                    matched


                    With a count of matches:



                    #! /usr/bin/awk -f

                    /FOO/
                    matched = 1
                    if (matches) print ""
                    printf "Match %dn", ++matches


                    /^$/
                    matched = 0


                    matched


                    In both cases, the first two blocks determine whether the current record should be copied to the output. When the current record matches “FOO”, the first block sets matched to 1, outputs a blank record if necessary (to separate the forthcoming output from the previous match); in the second variant, it also increments the matches counter and outputs a header. When the current record is empty, the second block sets matched to 0. The lonely matched condition prints the current record if matched is 1.






                    share|improve this answer





























                      5














                      I don’t think this is doable with grep, but it is with AWK:



                      #! /usr/bin/awk -f

                      /FOO/
                      matched = 1
                      if (notfirst) print ""
                      notfirst = 1


                      /^$/
                      matched = 0


                      matched


                      With a count of matches:



                      #! /usr/bin/awk -f

                      /FOO/
                      matched = 1
                      if (matches) print ""
                      printf "Match %dn", ++matches


                      /^$/
                      matched = 0


                      matched


                      In both cases, the first two blocks determine whether the current record should be copied to the output. When the current record matches “FOO”, the first block sets matched to 1, outputs a blank record if necessary (to separate the forthcoming output from the previous match); in the second variant, it also increments the matches counter and outputs a header. When the current record is empty, the second block sets matched to 0. The lonely matched condition prints the current record if matched is 1.






                      share|improve this answer



























                        5












                        5








                        5







                        I don’t think this is doable with grep, but it is with AWK:



                        #! /usr/bin/awk -f

                        /FOO/
                        matched = 1
                        if (notfirst) print ""
                        notfirst = 1


                        /^$/
                        matched = 0


                        matched


                        With a count of matches:



                        #! /usr/bin/awk -f

                        /FOO/
                        matched = 1
                        if (matches) print ""
                        printf "Match %dn", ++matches


                        /^$/
                        matched = 0


                        matched


                        In both cases, the first two blocks determine whether the current record should be copied to the output. When the current record matches “FOO”, the first block sets matched to 1, outputs a blank record if necessary (to separate the forthcoming output from the previous match); in the second variant, it also increments the matches counter and outputs a header. When the current record is empty, the second block sets matched to 0. The lonely matched condition prints the current record if matched is 1.






                        share|improve this answer















                        I don’t think this is doable with grep, but it is with AWK:



                        #! /usr/bin/awk -f

                        /FOO/
                        matched = 1
                        if (notfirst) print ""
                        notfirst = 1


                        /^$/
                        matched = 0


                        matched


                        With a count of matches:



                        #! /usr/bin/awk -f

                        /FOO/
                        matched = 1
                        if (matches) print ""
                        printf "Match %dn", ++matches


                        /^$/
                        matched = 0


                        matched


                        In both cases, the first two blocks determine whether the current record should be copied to the output. When the current record matches “FOO”, the first block sets matched to 1, outputs a blank record if necessary (to separate the forthcoming output from the previous match); in the second variant, it also increments the matches counter and outputs a header. When the current record is empty, the second block sets matched to 0. The lonely matched condition prints the current record if matched is 1.







                        share|improve this answer














                        share|improve this answer



                        share|improve this answer








                        edited 20 hours ago

























                        answered yesterday









                        Stephen KittStephen Kitt

                        177k24402480




                        177k24402480





















                            2














                            I've included a pcregrep solution and a python solution.



                            Multiline Grep Solution



                            If you have pcregrep installed, you could use a multiline pattern, such as ^.*FOO.*$n?(^.*S.*$n?)*, e.g.:



                            pcregrep -M '^.*FOO.*$n?(^.*S.*$n?)*' test.txt


                            The subexpression ^.*FOO.*$n? will match any line containing the string FOO and the subexpression (^.*S.*$n?)* will match any number of subsequent lines that containing a non-whitespace character.



                            Python Solution



                            Here is a Python script that should do what you want:



                            #!/usr/bin/env python3
                            # -*- encoding: utf8 -*-
                            """grep_follow.py

                            Search a text file for a pattern,
                            and output that pattern and the
                            non-empty lines which immediately follow it.
                            """

                            import re
                            import sys

                            # Get the search pattern and the input file as command-line arguments
                            pattern = sys.argv[1]
                            input_file = sys.argv[2]

                            # Set a flag to determine whether or not to output the current line
                            print_flag = False

                            with open(input_file, "r") as _input_file:

                            # Iterate over the lines of the input file
                            for line in _input_file:

                            # Remove trailing whitespace
                            line = line.rstrip()

                            # If the line is empty, stop producing output
                            if not line.strip():
                            print_flag = False

                            # If the line matches the search pattern, start producing output
                            elif re.search(pattern, line):
                            print_flag = True

                            # If the print flag is set then output the line
                            if print_flag:
                            print(line)


                            You would run it like this:



                            $ python grep_follow.py FOO test.txt


                            this line contains FOO
                            this line is not blank
                            This line also contains FOO
                            This line contains FOO too
                            Not blank
                            Also not blank
                            FOO!
                            Yet more random text
                            FOO!





                            share|improve this answer




















                            • 1





                              a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

                              – iruvar
                              yesterday















                            2














                            I've included a pcregrep solution and a python solution.



                            Multiline Grep Solution



                            If you have pcregrep installed, you could use a multiline pattern, such as ^.*FOO.*$n?(^.*S.*$n?)*, e.g.:



                            pcregrep -M '^.*FOO.*$n?(^.*S.*$n?)*' test.txt


                            The subexpression ^.*FOO.*$n? will match any line containing the string FOO and the subexpression (^.*S.*$n?)* will match any number of subsequent lines that containing a non-whitespace character.



                            Python Solution



                            Here is a Python script that should do what you want:



                            #!/usr/bin/env python3
                            # -*- encoding: utf8 -*-
                            """grep_follow.py

                            Search a text file for a pattern,
                            and output that pattern and the
                            non-empty lines which immediately follow it.
                            """

                            import re
                            import sys

                            # Get the search pattern and the input file as command-line arguments
                            pattern = sys.argv[1]
                            input_file = sys.argv[2]

                            # Set a flag to determine whether or not to output the current line
                            print_flag = False

                            with open(input_file, "r") as _input_file:

                            # Iterate over the lines of the input file
                            for line in _input_file:

                            # Remove trailing whitespace
                            line = line.rstrip()

                            # If the line is empty, stop producing output
                            if not line.strip():
                            print_flag = False

                            # If the line matches the search pattern, start producing output
                            elif re.search(pattern, line):
                            print_flag = True

                            # If the print flag is set then output the line
                            if print_flag:
                            print(line)


                            You would run it like this:



                            $ python grep_follow.py FOO test.txt


                            this line contains FOO
                            this line is not blank
                            This line also contains FOO
                            This line contains FOO too
                            Not blank
                            Also not blank
                            FOO!
                            Yet more random text
                            FOO!





                            share|improve this answer




















                            • 1





                              a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

                              – iruvar
                              yesterday













                            2












                            2








                            2







                            I've included a pcregrep solution and a python solution.



                            Multiline Grep Solution



                            If you have pcregrep installed, you could use a multiline pattern, such as ^.*FOO.*$n?(^.*S.*$n?)*, e.g.:



                            pcregrep -M '^.*FOO.*$n?(^.*S.*$n?)*' test.txt


                            The subexpression ^.*FOO.*$n? will match any line containing the string FOO and the subexpression (^.*S.*$n?)* will match any number of subsequent lines that containing a non-whitespace character.



                            Python Solution



                            Here is a Python script that should do what you want:



                            #!/usr/bin/env python3
                            # -*- encoding: utf8 -*-
                            """grep_follow.py

                            Search a text file for a pattern,
                            and output that pattern and the
                            non-empty lines which immediately follow it.
                            """

                            import re
                            import sys

                            # Get the search pattern and the input file as command-line arguments
                            pattern = sys.argv[1]
                            input_file = sys.argv[2]

                            # Set a flag to determine whether or not to output the current line
                            print_flag = False

                            with open(input_file, "r") as _input_file:

                            # Iterate over the lines of the input file
                            for line in _input_file:

                            # Remove trailing whitespace
                            line = line.rstrip()

                            # If the line is empty, stop producing output
                            if not line.strip():
                            print_flag = False

                            # If the line matches the search pattern, start producing output
                            elif re.search(pattern, line):
                            print_flag = True

                            # If the print flag is set then output the line
                            if print_flag:
                            print(line)


                            You would run it like this:



                            $ python grep_follow.py FOO test.txt


                            this line contains FOO
                            this line is not blank
                            This line also contains FOO
                            This line contains FOO too
                            Not blank
                            Also not blank
                            FOO!
                            Yet more random text
                            FOO!





                            share|improve this answer















                            I've included a pcregrep solution and a python solution.



                            Multiline Grep Solution



                            If you have pcregrep installed, you could use a multiline pattern, such as ^.*FOO.*$n?(^.*S.*$n?)*, e.g.:



                            pcregrep -M '^.*FOO.*$n?(^.*S.*$n?)*' test.txt


                            The subexpression ^.*FOO.*$n? will match any line containing the string FOO and the subexpression (^.*S.*$n?)* will match any number of subsequent lines that containing a non-whitespace character.



                            Python Solution



                            Here is a Python script that should do what you want:



                            #!/usr/bin/env python3
                            # -*- encoding: utf8 -*-
                            """grep_follow.py

                            Search a text file for a pattern,
                            and output that pattern and the
                            non-empty lines which immediately follow it.
                            """

                            import re
                            import sys

                            # Get the search pattern and the input file as command-line arguments
                            pattern = sys.argv[1]
                            input_file = sys.argv[2]

                            # Set a flag to determine whether or not to output the current line
                            print_flag = False

                            with open(input_file, "r") as _input_file:

                            # Iterate over the lines of the input file
                            for line in _input_file:

                            # Remove trailing whitespace
                            line = line.rstrip()

                            # If the line is empty, stop producing output
                            if not line.strip():
                            print_flag = False

                            # If the line matches the search pattern, start producing output
                            elif re.search(pattern, line):
                            print_flag = True

                            # If the print flag is set then output the line
                            if print_flag:
                            print(line)


                            You would run it like this:



                            $ python grep_follow.py FOO test.txt


                            this line contains FOO
                            this line is not blank
                            This line also contains FOO
                            This line contains FOO too
                            Not blank
                            Also not blank
                            FOO!
                            Yet more random text
                            FOO!






                            share|improve this answer














                            share|improve this answer



                            share|improve this answer








                            edited yesterday

























                            answered yesterday









                            igaligal

                            5,9611536




                            5,9611536







                            • 1





                              a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

                              – iruvar
                              yesterday












                            • 1





                              a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

                              – iruvar
                              yesterday







                            1




                            1





                            a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

                            – iruvar
                            yesterday





                            a more intuitive regex in the eyes of this beholder is '(?s)^N*FOO.*?(?=Z|nn|N*FOON*)', but +1

                            – iruvar
                            yesterday











                            1














                            awk '/FOO/print "===match " ++i "===" /FOO/,/^$/' file

                            ===match 1===
                            this line contains FOO
                            this line is not blank

                            ===match 2===
                            This line also contains FOO

                            ===match 3===
                            This line contains FOO too
                            Not blank
                            Also not blank

                            ===match 4===
                            FOO!
                            Yet more random text
                            ===match 5===
                            FOO!


                            A similar variant where FOO could be easily changed to something else:



                            awk -vpat=FOO '$0~patprint "===match " ++i "===" $0~pat,/^$/' file


                            Omitting the terminating empty line from the default print is left as an exercise to the reader ;-)






                            share|improve this answer



























                              1














                              awk '/FOO/print "===match " ++i "===" /FOO/,/^$/' file

                              ===match 1===
                              this line contains FOO
                              this line is not blank

                              ===match 2===
                              This line also contains FOO

                              ===match 3===
                              This line contains FOO too
                              Not blank
                              Also not blank

                              ===match 4===
                              FOO!
                              Yet more random text
                              ===match 5===
                              FOO!


                              A similar variant where FOO could be easily changed to something else:



                              awk -vpat=FOO '$0~patprint "===match " ++i "===" $0~pat,/^$/' file


                              Omitting the terminating empty line from the default print is left as an exercise to the reader ;-)






                              share|improve this answer

























                                1












                                1








                                1







                                awk '/FOO/print "===match " ++i "===" /FOO/,/^$/' file

                                ===match 1===
                                this line contains FOO
                                this line is not blank

                                ===match 2===
                                This line also contains FOO

                                ===match 3===
                                This line contains FOO too
                                Not blank
                                Also not blank

                                ===match 4===
                                FOO!
                                Yet more random text
                                ===match 5===
                                FOO!


                                A similar variant where FOO could be easily changed to something else:



                                awk -vpat=FOO '$0~patprint "===match " ++i "===" $0~pat,/^$/' file


                                Omitting the terminating empty line from the default print is left as an exercise to the reader ;-)






                                share|improve this answer













                                awk '/FOO/print "===match " ++i "===" /FOO/,/^$/' file

                                ===match 1===
                                this line contains FOO
                                this line is not blank

                                ===match 2===
                                This line also contains FOO

                                ===match 3===
                                This line contains FOO too
                                Not blank
                                Also not blank

                                ===match 4===
                                FOO!
                                Yet more random text
                                ===match 5===
                                FOO!


                                A similar variant where FOO could be easily changed to something else:



                                awk -vpat=FOO '$0~patprint "===match " ++i "===" $0~pat,/^$/' file


                                Omitting the terminating empty line from the default print is left as an exercise to the reader ;-)







                                share|improve this answer












                                share|improve this answer



                                share|improve this answer










                                answered yesterday









                                mosvymosvy

                                8,3521732




                                8,3521732





















                                    0














                                    One way can be using Perl's range operator ...:



                                    $ perl -lne '
                                    print s|^(?=.*FOO)|$/."MATCH#".++$c.$/|re if /FOO/ ... /^$/;
                                    ' input.txt

                                    MATCH#1
                                    this line contains FOO
                                    this line is not blank


                                    MATCH#2
                                    This line also contains FOO


                                    MATCH#3
                                    This line contains FOO too
                                    Not blank
                                    Also not blank


                                    MATCH#4
                                    FOO!
                                    Yet more random text

                                    MATCH#5
                                    FOO!


                                    In case the extra blank lines are an issue, you can use the below code, where make use of the range operator in scalar context in order to have a peek into the state machine values and perform actions based on them.



                                    Note :



                                    $/ = RS = "n"



                                    $, = OFS = ""



                                    $ perl -lne '
                                    print
                                    s^(?=.*FOO)

                                    ($,,$/)[$r>1] .
                                    "MATCH#" . ++$count . $/
                                    rex
                                    if $r = /FOO/ ... /^$/;
                                    ' input.txt


                                    Here's another method to tackle the pbm, this time using the paragraph mode of Perl. We read in records a para at a time and split them on newlines into fields.



                                    Then we make sure to handle only those paras that happen to have the string foo in them. Finally, we print the fields with the constraint on foo-containing fields being treated specially. Even here we deal with the first field differently than the rest.



                                    $ perl -aln -F'n' -00 -e '
                                    next unless /FOO/;
                                    shift @F until $F[0] =~ /FOO/;
                                    push @F, $, if ! eof;
                                    print "MATCH#", ++$k, $, shift @F;
                                    print for map /FOO/ and $_ = "nMATCH#" . ++$k . "n$_";$_ @F;
                                    ' input.txt





                                    share|improve this answer





























                                      0














                                      One way can be using Perl's range operator ...:



                                      $ perl -lne '
                                      print s|^(?=.*FOO)|$/."MATCH#".++$c.$/|re if /FOO/ ... /^$/;
                                      ' input.txt

                                      MATCH#1
                                      this line contains FOO
                                      this line is not blank


                                      MATCH#2
                                      This line also contains FOO


                                      MATCH#3
                                      This line contains FOO too
                                      Not blank
                                      Also not blank


                                      MATCH#4
                                      FOO!
                                      Yet more random text

                                      MATCH#5
                                      FOO!


                                      In case the extra blank lines are an issue, you can use the below code, where make use of the range operator in scalar context in order to have a peek into the state machine values and perform actions based on them.



                                      Note :



                                      $/ = RS = "n"



                                      $, = OFS = ""



                                      $ perl -lne '
                                      print
                                      s^(?=.*FOO)

                                      ($,,$/)[$r>1] .
                                      "MATCH#" . ++$count . $/
                                      rex
                                      if $r = /FOO/ ... /^$/;
                                      ' input.txt


                                      Here's another method to tackle the pbm, this time using the paragraph mode of Perl. We read in records a para at a time and split them on newlines into fields.



                                      Then we make sure to handle only those paras that happen to have the string foo in them. Finally, we print the fields with the constraint on foo-containing fields being treated specially. Even here we deal with the first field differently than the rest.



                                      $ perl -aln -F'n' -00 -e '
                                      next unless /FOO/;
                                      shift @F until $F[0] =~ /FOO/;
                                      push @F, $, if ! eof;
                                      print "MATCH#", ++$k, $, shift @F;
                                      print for map /FOO/ and $_ = "nMATCH#" . ++$k . "n$_";$_ @F;
                                      ' input.txt





                                      share|improve this answer



























                                        0












                                        0








                                        0







                                        One way can be using Perl's range operator ...:



                                        $ perl -lne '
                                        print s|^(?=.*FOO)|$/."MATCH#".++$c.$/|re if /FOO/ ... /^$/;
                                        ' input.txt

                                        MATCH#1
                                        this line contains FOO
                                        this line is not blank


                                        MATCH#2
                                        This line also contains FOO


                                        MATCH#3
                                        This line contains FOO too
                                        Not blank
                                        Also not blank


                                        MATCH#4
                                        FOO!
                                        Yet more random text

                                        MATCH#5
                                        FOO!


                                        In case the extra blank lines are an issue, you can use the below code, where make use of the range operator in scalar context in order to have a peek into the state machine values and perform actions based on them.



                                        Note :



                                        $/ = RS = "n"



                                        $, = OFS = ""



                                        $ perl -lne '
                                        print
                                        s^(?=.*FOO)

                                        ($,,$/)[$r>1] .
                                        "MATCH#" . ++$count . $/
                                        rex
                                        if $r = /FOO/ ... /^$/;
                                        ' input.txt


                                        Here's another method to tackle the pbm, this time using the paragraph mode of Perl. We read in records a para at a time and split them on newlines into fields.



                                        Then we make sure to handle only those paras that happen to have the string foo in them. Finally, we print the fields with the constraint on foo-containing fields being treated specially. Even here we deal with the first field differently than the rest.



                                        $ perl -aln -F'n' -00 -e '
                                        next unless /FOO/;
                                        shift @F until $F[0] =~ /FOO/;
                                        push @F, $, if ! eof;
                                        print "MATCH#", ++$k, $, shift @F;
                                        print for map /FOO/ and $_ = "nMATCH#" . ++$k . "n$_";$_ @F;
                                        ' input.txt





                                        share|improve this answer















                                        One way can be using Perl's range operator ...:



                                        $ perl -lne '
                                        print s|^(?=.*FOO)|$/."MATCH#".++$c.$/|re if /FOO/ ... /^$/;
                                        ' input.txt

                                        MATCH#1
                                        this line contains FOO
                                        this line is not blank


                                        MATCH#2
                                        This line also contains FOO


                                        MATCH#3
                                        This line contains FOO too
                                        Not blank
                                        Also not blank


                                        MATCH#4
                                        FOO!
                                        Yet more random text

                                        MATCH#5
                                        FOO!


                                        In case the extra blank lines are an issue, you can use the below code, where make use of the range operator in scalar context in order to have a peek into the state machine values and perform actions based on them.



                                        Note :



                                        $/ = RS = "n"



                                        $, = OFS = ""



                                        $ perl -lne '
                                        print
                                        s^(?=.*FOO)

                                        ($,,$/)[$r>1] .
                                        "MATCH#" . ++$count . $/
                                        rex
                                        if $r = /FOO/ ... /^$/;
                                        ' input.txt


                                        Here's another method to tackle the pbm, this time using the paragraph mode of Perl. We read in records a para at a time and split them on newlines into fields.



                                        Then we make sure to handle only those paras that happen to have the string foo in them. Finally, we print the fields with the constraint on foo-containing fields being treated specially. Even here we deal with the first field differently than the rest.



                                        $ perl -aln -F'n' -00 -e '
                                        next unless /FOO/;
                                        shift @F until $F[0] =~ /FOO/;
                                        push @F, $, if ! eof;
                                        print "MATCH#", ++$k, $, shift @F;
                                        print for map /FOO/ and $_ = "nMATCH#" . ++$k . "n$_";$_ @F;
                                        ' input.txt






                                        share|improve this answer














                                        share|improve this answer



                                        share|improve this answer








                                        edited yesterday

























                                        answered yesterday









                                        Rakesh SharmaRakesh Sharma

                                        342115




                                        342115





















                                            0














                                            Here is a one-liner that may not exactly match the criteria, but comes close enough for most purposes.



                                            gawk '/FOO/p=1 if(p) print /^$/p=0' infile.txt


                                            First rule sets p=1 if it sees FOO. Second rule prints the current line if p is not zero. Third rule sets p=0 if the line (already printed) is blank. Swap second and third rules if you do not want the blank line terminator to be output.



                                            This is a variant which numbers and separates the matches if there are multiple FOO instances not separated by blank lines



                                            gawk '/FOO/p=1; n++; print "n" n /^$/p=0 //if (p) print $0 ' infile.txt





                                            share|improve this answer



























                                              0














                                              Here is a one-liner that may not exactly match the criteria, but comes close enough for most purposes.



                                              gawk '/FOO/p=1 if(p) print /^$/p=0' infile.txt


                                              First rule sets p=1 if it sees FOO. Second rule prints the current line if p is not zero. Third rule sets p=0 if the line (already printed) is blank. Swap second and third rules if you do not want the blank line terminator to be output.



                                              This is a variant which numbers and separates the matches if there are multiple FOO instances not separated by blank lines



                                              gawk '/FOO/p=1; n++; print "n" n /^$/p=0 //if (p) print $0 ' infile.txt





                                              share|improve this answer

























                                                0












                                                0








                                                0







                                                Here is a one-liner that may not exactly match the criteria, but comes close enough for most purposes.



                                                gawk '/FOO/p=1 if(p) print /^$/p=0' infile.txt


                                                First rule sets p=1 if it sees FOO. Second rule prints the current line if p is not zero. Third rule sets p=0 if the line (already printed) is blank. Swap second and third rules if you do not want the blank line terminator to be output.



                                                This is a variant which numbers and separates the matches if there are multiple FOO instances not separated by blank lines



                                                gawk '/FOO/p=1; n++; print "n" n /^$/p=0 //if (p) print $0 ' infile.txt





                                                share|improve this answer













                                                Here is a one-liner that may not exactly match the criteria, but comes close enough for most purposes.



                                                gawk '/FOO/p=1 if(p) print /^$/p=0' infile.txt


                                                First rule sets p=1 if it sees FOO. Second rule prints the current line if p is not zero. Third rule sets p=0 if the line (already printed) is blank. Swap second and third rules if you do not want the blank line terminator to be output.



                                                This is a variant which numbers and separates the matches if there are multiple FOO instances not separated by blank lines



                                                gawk '/FOO/p=1; n++; print "n" n /^$/p=0 //if (p) print $0 ' infile.txt






                                                share|improve this answer












                                                share|improve this answer



                                                share|improve this answer










                                                answered 13 hours ago









                                                nigel222nigel222

                                                1514




                                                1514



























                                                    draft saved

                                                    draft discarded
















































                                                    Thanks for contributing an answer to Unix & Linux Stack Exchange!


                                                    • Please be sure to answer the question. Provide details and share your research!

                                                    But avoid


                                                    • Asking for help, clarification, or responding to other answers.

                                                    • Making statements based on opinion; back them up with references or personal experience.

                                                    To learn more, see our tips on writing great answers.




                                                    draft saved


                                                    draft discarded














                                                    StackExchange.ready(
                                                    function ()
                                                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f507517%2fgrepping-string-but-include-all-non-blank-lines-following-each-grep-match%23new-answer', 'question_page');

                                                    );

                                                    Post as a guest















                                                    Required, but never shown





















































                                                    Required, but never shown














                                                    Required, but never shown












                                                    Required, but never shown







                                                    Required, but never shown

































                                                    Required, but never shown














                                                    Required, but never shown












                                                    Required, but never shown







                                                    Required, but never shown







                                                    Popular posts from this blog

                                                    Sum ergo cogito? 1 nng

                                                    419 nièngy_Soadمي 19bal1.5o_g

                                                    Queiggey Chernihivv 9NnOo i Zw X QqKk LpB