CommonGramsFilter

Generates bigrams for frequently occurring terms (common grams).

Import

import CommonGramsFilter from 'dynamosearch/filters/CommonGramsFilter';

Constructor

new CommonGramsFilter(options: { commonWords: string[] })

Parameters

• commonWords (string[]) - Array of common words to create bigrams for

Example

const filter = new CommonGramsFilter({ commonWords: ['the', 'of'] });
const tokens = filter.apply([
  { token: 'best', startOffset: 0, endOffset: 4, position: 0 },
  { token: 'of', startOffset: 5, endOffset: 7, position: 1 },
  { token: 'times', startOffset: 8, endOffset: 13, position: 2 },
]);
// Generates: best, of, best_of, of_times, times

Best For

• Phrase matching with common words
• Improving search with stop words
• Creating bigrams for frequent terms

See Also

• ShingleFilter - For general word shingles
• StopFilter - For removing stop words