Search moodle.org's
Developer Documentation

See Release Notes
Long Term Support Release

  • Bug fixes for general core bugs in 4.1.x will end 13 November 2023 (12 months).
  • Bug fixes for security issues in 4.1.x will end 10 November 2025 (36 months).
  • PHP version: minimum PHP 7.4.0 Note: minimum PHP version has increased since Moodle 4.0. PHP 8.0.x is supported too.
/lib/mlbackend/php/phpml/src/Phpml/Tokenization/ -> WordTokenizer.php (source)

[Summary view] 

   1  <?php
   2  
   3  declare(strict_types=1);
   4  
   5  namespace Phpml\Tokenization;
   6  
   7  class WordTokenizer implements Tokenizer
   8  {
   9      public function tokenize(string $text): array
  10      {
  11          $tokens = [];
  12          preg_match_all('/\w\w+/u', $text, $tokens);
  13  
  14          return $tokens[0];
  15      }
  16  }

Body

Body

Body

Body