Commit 5b5f45e9dde77df4e8da50ac2a102db6bfc2aa27
1 parent
fefe2503
Remove lexer rewrite notes from TODO
Showing
1 changed file
with
1 additions
and
13 deletions
TODO
| @@ -40,24 +40,12 @@ Soon | @@ -40,24 +40,12 @@ Soon | ||
| 40 | Lexical | 40 | Lexical |
| 41 | ======= | 41 | ======= |
| 42 | 42 | ||
| 43 | -Consider rewriting the tokenizer. These are rough ideas at this point. | ||
| 44 | -I may or may not do this as described. | ||
| 45 | - | ||
| 46 | - * Use flex. Generate them from ./autogen.sh and include them in the | ||
| 47 | - source package, but do not commit them. | ||
| 48 | - | ||
| 49 | - * Make it possible to run the lexer (tokenizer) over a while file | 43 | + * Make it possible to run the lexer (tokenizer) over a whole file |
| 50 | such that the following things would be possible: | 44 | such that the following things would be possible: |
| 51 | 45 | ||
| 52 | * Rewrite fix-qdf in C++ so that there is no longer a runtime perl | 46 | * Rewrite fix-qdf in C++ so that there is no longer a runtime perl |
| 53 | dependency | 47 | dependency |
| 54 | 48 | ||
| 55 | - * Create a way to filter content streams that could be used to | ||
| 56 | - preserve the content stream exactly including spaces but also to | ||
| 57 | - do things like replace everything between a detected set of | ||
| 58 | - markers. This is to support form flattening. Ideally, it should | ||
| 59 | - be possible to use this programmatically on broken files. | ||
| 60 | - | ||
| 61 | * Make it possible to replace all strings in a file lexically even | 49 | * Make it possible to replace all strings in a file lexically even |
| 62 | on badly broken files. Ideally this should work files that are | 50 | on badly broken files. Ideally this should work files that are |
| 63 | lacking xref, have broken links, etc., and ideally it should work | 51 | lacking xref, have broken links, etc., and ideally it should work |