Commit 5b5f45e9dde77df4e8da50ac2a102db6bfc2aa27
1 parent
fefe2503
Remove lexer rewrite notes from TODO
Showing
1 changed file
with
1 additions
and
13 deletions
TODO
| ... | ... | @@ -40,24 +40,12 @@ Soon |
| 40 | 40 | Lexical |
| 41 | 41 | ======= |
| 42 | 42 | |
| 43 | -Consider rewriting the tokenizer. These are rough ideas at this point. | |
| 44 | -I may or may not do this as described. | |
| 45 | - | |
| 46 | - * Use flex. Generate them from ./autogen.sh and include them in the | |
| 47 | - source package, but do not commit them. | |
| 48 | - | |
| 49 | - * Make it possible to run the lexer (tokenizer) over a while file | |
| 43 | + * Make it possible to run the lexer (tokenizer) over a whole file | |
| 50 | 44 | such that the following things would be possible: |
| 51 | 45 | |
| 52 | 46 | * Rewrite fix-qdf in C++ so that there is no longer a runtime perl |
| 53 | 47 | dependency |
| 54 | 48 | |
| 55 | - * Create a way to filter content streams that could be used to | |
| 56 | - preserve the content stream exactly including spaces but also to | |
| 57 | - do things like replace everything between a detected set of | |
| 58 | - markers. This is to support form flattening. Ideally, it should | |
| 59 | - be possible to use this programmatically on broken files. | |
| 60 | - | |
| 61 | 49 | * Make it possible to replace all strings in a file lexically even |
| 62 | 50 | on badly broken files. Ideally this should work files that are |
| 63 | 51 | lacking xref, have broken links, etc., and ideally it should work | ... | ... |