ASCIIFoldingFilter

Converts accented characters to their ASCII equivalents.

Import

import ASCIIFoldingFilter from 'dynamosearch/filters/ASCIIFoldingFilter';

Constructor

new ASCIIFoldingFilter()

No parameters required.

Example

const filter = new ASCIIFoldingFilter();
const tokens = filter.apply([
  { token: 'café', startOffset: 0, endOffset: 4, position: 0 },
  { token: 'résumé', startOffset: 5, endOffset: 11, position: 1 },
  { token: 'naïve', startOffset: 12, endOffset: 17, position: 2 },
  { token: 'Zürich', startOffset: 18, endOffset: 24, position: 3 },
]);
// [
//   { token: 'cafe', startOffset: 0, endOffset: 4, position: 0 },
//   { token: 'resume', startOffset: 5, endOffset: 11, position: 1 },
//   { token: 'naive', startOffset: 12, endOffset: 17, position: 2 },
//   { token: 'Zurich', startOffset: 18, endOffset: 24, position: 3 }
// ]

Best For

• Normalizing international text
• Language-agnostic search
• Handling user input with accents
• Improving search recall

See Also

• ICUNormalizer - For Unicode normalization