What is a non-capturing group in regular expressions?

Let me try to explain this with an example.

Consider the following text:

http://stackoverflow.com/
https://stackoverflow.com/questions/tagged/regex

Now, if I apply the regex below over it…

(https?|ftp)://([^/\r\n]+)(/[^\r\n]*)?

… I would get the following result:

Match "http://stackoverflow.com/"
     Group 1: "http"
     Group 2: "stackoverflow.com"
     Group 3: "/"

Match "https://stackoverflow.com/questions/tagged/regex"
     Group 1: "https"
     Group 2: "stackoverflow.com"
     Group 3: "/questions/tagged/regex"

But I don’t care about the protocol — I just want the host and path of the URL. So, I change the regex to include the non-capturing group (?:).

(?:https?|ftp)://([^/\r\n]+)(/[^\r\n]*)?

Now, my result looks like this:

Match "http://stackoverflow.com/"
     Group 1: "stackoverflow.com"
     Group 2: "/"

Match "https://stackoverflow.com/questions/tagged/regex"
     Group 1: "stackoverflow.com"
     Group 2: "/questions/tagged/regex"

See? The first group has not been captured. The parser uses it to match the text, but ignores it later, in the final result.

EDIT:

As requested, let me try to explain groups too.

Well, groups serve many purposes. They can help you to extract exact information from a bigger match (which can also be named), they let you rematch a previous matched group, and can be used for substitutions. Let’s try some examples, shall we?

Imagine you have some kind of XML or HTML (be aware that regex may not be the best tool for the job, but it is nice as an example). You want to parse the tags, so you could do something like this (I have added spaces to make it easier to understand):

   \<(?<TAG>.+?)\> [^<]*? \</\k<TAG>\>
or
   \<(.+?)\> [^<]*? \</\1\>

The first regex has a named group (TAG), while the second one uses a common group. Both regexes do the same thing: they use the value from the first group (the name of the tag) to match the closing tag. The difference is that the first one uses the name to match the value, and the second one uses the group index (which starts at 1).

Let’s try some substitutions now. Consider the following text:

Lorem ipsum dolor sit amet consectetuer feugiat fames malesuada pretium egestas.

Now, let’s use this dumb regex over it:

\b(\S)(\S)(\S)(\S*)\b

This regex matches words with at least 3 characters, and uses groups to separate the first three letters. The result is this:

Match "Lorem"
     Group 1: "L"
     Group 2: "o"
     Group 3: "r"
     Group 4: "em"
Match "ipsum"
     Group 1: "i"
     Group 2: "p"
     Group 3: "s"
     Group 4: "um"
...

Match "consectetuer"
     Group 1: "c"
     Group 2: "o"
     Group 3: "n"
     Group 4: "sectetuer"
...

So, if we apply the substitution string:

$1_$3$2_$4

… over it, we are trying to use the first group, add an underscore, use the third group, then the second group, add another underscore, and then the fourth group. The resulting string would be like the one below.

L_ro_em i_sp_um d_lo_or s_ti_ a_em_t c_no_sectetuer f_ue_giat f_ma_es m_la_esuada p_er_tium e_eg_stas.

You can use named groups for substitutions too, using ${name}.

To play around with regexes, I recommend http://regex101.com/, which offers a good amount of details on how the regex works; it also offers a few regex engines to choose from.

Related Posts:

  1. What is a non-capturing group in regular expressions?
  2. Regex optional group
  3. Regex optional capturing group?
  4. OR condition in Regex
  5. Using or ‘|’ in regex [duplicate]
  6. What is a Context Free Grammar?
  7. How can I validate an email address using a regular expression?
  8. Regular expression to match a line that doesn’t contain a word
  9. Difference between \b and \B in regex
  10. What does the regex \S mean in JavaScript?
  11. How can I validate an email address using a regular expression?
  12. Regex: ignore case sensitivity
  13. Python regex AttributeError: ‘NoneType’ object has no attribute ‘group’
  14. Regular Expression for alphanumeric and underscores
  15. What is the difference between the regular expressions [^\d\s] and [\D\S]
  16. Regular Expression for alphanumeric and underscores
  17. python re.split() to split by spaces, commas, and periods, but not in cases like 1,000 or 1.50
  18. python re.split() to split by spaces, commas, and periods, but not in cases like 1,000 or 1.50
  19. Regex to test if string begins with http:// or https://
  20. Regular expression negative lookahead
  21. Regular Expressions: Is there an AND operator?
  22. Writing a very simple lexical analyser in C++
  23. Regular Expression.how to add optional character at end of regex
  24. Regular Expression with wildcards to match any character
  25. Split string on whitespace in Python
  26. Regular expression to match standard 10 digit phone number
  27. Python string.replace regular expression
  28. Python string.replace regular expression
  29. Symbol for any number of any characters in regex?
  30. Regex – Does not contain certain Characters
  31. How to replace ” \ ” with ” \\ ” in java
  32. A regular expression to exclude a word/string
  33. Regex how to match an optional character
  34. How to validate an email address in JavaScript
  35. Searching for UUIDs in text with regex
  36. Regular expression to match a word or its prefix
  37. How can I remove punctuation from input text in Java?
  38. Regular expression for exact match of a string
  39. Using the star sign in grep
  40. Question marks in regular expressions
  41. Difference between \w and \b regular expression meta characters
  42. Regular Expression – Validate Gmail addresses
  43. Java; String replace (using regular expressions)?
  44. How can I remove punctuation from input text in Java?
  45. How can I output only captured groups with sed?
  46. How to negate specific word in regex?
  47. javascript HTML from document.body.innerHTML
  48. Which regular expression operator means ‘Don’t’ match this character?
  49. How can I write a regex which matches non greedy?
  50. Regex Explanation ^.*$ [duplicate]
  51. Negative matching using grep (match lines that do not contain foo)
  52. How to exclude a specific string constant?
  53. How to replace a whole line with sed?
  54. Regex match everything after question mark?
  55. Validating IPv4 addresses with regexp
  56. Validate phone number with JavaScript
  57. How is \\n and \\\n interpreted by the expanded regular expression?
  58. Regex to match only uppercase “words” with some exceptions
  59. Regular Expression to reformat a US phone number in Javascript
  60. Regex to match only letters
  61. Finding the complement of a DFA?
  62. RegEx to find two or more consecutive chars
  63. RE error: illegal byte sequence on Mac OS X
  64. Regex to match an optional ‘+’ symbol followed by any number of digits
  65. Regex Match all characters between two strings
  66. Regular expression to match a word or its prefix
  67. Regular expressions in C: examples?
  68. How to ignore whitespace in a regular expression subject string?
  69. Regular expression for a string that does not start with a sequence
  70. What does this Django regular expression mean? `?P`
  71. Regex: matching up to the first occurrence of a character
  72. python regular expression “\1”
  73. Regular expression – starting and ending with a character string
  74. Regular expression to stop at first match
  75. /bb|[^b]{2}/ how does it work?
  76. How do I match any character across multiple lines in a regular expression?
  77. Regular expression to remove HTML tags from a string
  78. Regular expression to limit number of characters to 10
  79. Regular Expressions- Match Anything
  80. My Vim replace with a regex is throwing a `E488: Trailing characters`
  81. Regex for “AND NOT” operation
  82. Regular expression that matches valid IPv6 addresses
  83. Escaping Parentheses in Regex
  84. How to replace a string in an existing file in Perl
  85. What is the best regular expression to check if a string is a valid URL?
  86. Regex empty string or email
  87. Regex to validate date formats dd/mm/YYYY, dd-mm-YYYY, dd.mm.YYYY, dd mmm YYYY, dd-mmm-YYYY, dd/mmm/YYYY, dd.mmm.YYYY with Leap Year Support
  88. Regex difference: (\w+)? and (\w*)
  89. Wrap element with in any number of elements with PHP
  90. 404 regular-expression advice needed
  91. How to use a variable as a className inside preg_match_all parameters?
  92. How to set up redirects for category paginated pages after adding /category/ to permalink
  93. Adding span tags to post titles using regex
  94. Redirect non www to www using redirection plugin regex
  95. Restrict comments with regular expression
  96. Remove Custom HTML Posts Using Regex
  97. Regexes allow only [a-z][A-Z][0-9] and –
  98. Call Shortcode Attribute Value within another function
  99. How to fix old embeded iframes with WP-CLI search-replace
  100. Use Regex Redirection via htsaccess for RSS Feeds WordPress

Leave a Comment