v1.1 RC #47

campb303 · 2021-08-03T02:48:36Z

Rewrote parser with a formal grammar using pyparsing.
Implementing multi-threading in parser for Queue class and load_queues utility.
Implemented config file support.
Fixed bug where unreadable lock files would break item lock detection.

…e to format_date_string

…initial message content

…or the "to" and "cc" keys

… attributes

…ction

…ions function" This reverts commit e7e7687.

…ctions by the datetime key

… to indicate malformed header information in the reply from user section

… by a newline

…ctly in the reply_from_user section

… item.py module

…essage when the parser encounters a malformed delimiter

…ade the skipTo look for delimiters at the begining of the line

…e the skipTo look for delimiters at the begining of the line

…r and made the skipTo look for delimiters at the begining of the line

…at the start of a given line in the status, edit, and reply-to-user rules

…if a Date header is not found in a reply from user section

…e formatted in a particular way

…e starmap_async function in the multiprocessing package

… the list of items

…at represent the different queues) and a headers_only boolean value. Modified the docstring accordingly

…cesses

…custom class from the previous comitt that allows subprocesses to spawn other subprocesses

…ssible read/write permission issues

…the root of the webqueue2api package directory and read the configurations from that file if so

…ains a queue_directory in the parser section

…tion file under the parser section

… config file under the api section

… the config file under the api section

modified logic to avoid directly reading lock file contents due to possible read/write permission issues

Feature rewrite parser in formal grammar

…oading-multiple-queues-and-items Add support for multi-threadded Queue loading

…e-for-webqueue2api-configs Feature implement config file override for webqueue2api configs

benne238 added 30 commits June 28, 2021 12:45

Remove old ECNQueue module

e634be1

Add pyparsing to requirements

2648c8e

Add ParseError to parser module

425b41a

Move Item.__get_formatted_date to webqueue2api.parser.utils and renam…

dc11658

…e to format_date_string

Refactor to use new format_date_string function

12407b0

replaced old parser and imported new pyparsing parser in the item class

7ee915f

Fixed bug where the end of the string was not matched

5738191

created function to append the initial message headers to the parsed …

c7e0d0a

…initial message content

modifed __add_initial_message_headers to output the expected format f…

0f69c18

…or the "to" and "cc" keys

Moved the content attribute in item to be defined after all the other…

42bb135

… attributes

add_intitial_message_headers function call from the parseSections fun…

e7e7687

…ction

Revert "add_intitial_message_headers function call from the parseSect…

b701cda

…ions function" This reverts commit e7e7687.

return initial message section with appropriate headers

3951832

formatted function names to camel case

b9d4945

add function call to __get_sorted_sections to sort the parsed item se…

de2dd76

…ctions by the datetime key

add assignment parsing to item.py

4dfb974

modified repy_from_user_end_delimiter to not include an ending newline

d858c0c

added a condition that checks for an ending reply from user delimiter…

56798fb

… to indicate malformed header information in the reply from user section

fixed error message for header information not seperated from content…

f61860e

… by a newline

Add logic to return an error_parse if a header is not formatted corre…

8289ae7

…ctly in the reply_from_user section

moved the email.policy configuration from the parser.py module to the…

f5e5619

… item.py module

modified action end delimiter and modified the expected value error m…

595b1be

…essage when the parser encounters a malformed delimiter

modified the status rule to expect only a single line delimiter and m…

66b65d7

…ade the skipTo look for delimiters at the begining of the line

modified the edit rule to expect only a single line delimiter and mad…

5fbc373

…e the skipTo look for delimiters at the begining of the line

modified the reply to user rule to expect only a single line delimite…

a3fafba

…r and made the skipTo look for delimiters at the begining of the line

added pp.LineStart() to explicity look for reply_from_user delimiter …

1d0358c

…at the start of a given line in the status, edit, and reply-to-user rules

Added logic to raise a parser error with the appropriate information …

f7114c2

…if a Date header is not found in a reply from user section

Made expected message relevent: the datetime string doesn't need to b…

a84d8e7

…e formatted in a particular way

added docstring to __get_assignments

5383f8f

added docstring to __parse_sections

23abdf3

benne238 and others added 29 commits July 12, 2021 09:38

import multiprocessing package in queue.py

90ba300

Added logic to parse multiple items at once in a given queue using th…

d8e722b

…e starmap_async function in the multiprocessing package

Added code to wait until all of the items are loaded before returning…

5a30f2d

… the list of items

Modified load_queues function in queue.py to accept *args (strings th…

55cb9ad

…at represent the different queues) and a headers_only boolean value. Modified the docstring accordingly

created a custom class that allows subprocesses to spawn other subpro…

81e28e5

…cesses

added logic to parse multiple queues with multiparsing using the the …

ab565ec

…custom class from the previous comitt that allows subprocesses to spawn other subprocesses

modified logic to avoid directly reading lock file contents due to po…

60254aa

…ssible read/write permission issues

Added basic logic to check if the webqueue2api_config file exists in …

3ec46b8

…the root of the webqueue2api package directory and read the configurations from that file if so

Logic to overwrite the queue_directory if the configuration file cont…

7dc383b

…ains a queue_directory in the parser section

Logic to overwrite the queues_to_ignore if it exists in the configura…

b11d2a8

…tion file under the parser section

Added logic to overwrite the environment variable if it exists in the…

e8115fc

… config file under the api section

Added logic to overwrite the jwt_secret_key if the variable exists in…

0a30503

… the config file under the api section

Add docs about section parsing

6c6c990

Add wildcard delimiter to webqueue2api Package directory for parser docs

a3387af

Merge pull request #40 from ECN/enhancement-lock-file-change

58bf454

modified logic to avoid directly reading lock file contents due to possible read/write permission issues

Remove unused datetime import

84cb7b4

Correct __add_initial_message_headers doc block

80cc1cb

Cleanup __get_sorted_sections

5e07895

Rename reply to user delimiter

206ed36

Merge pull request #41 from ECN/feature-rewrite-parser-in-formal-grammar

5c10453

Feature rewrite parser in formal grammar

Docs cleanup

49ad6e8

Merge pull request #45 from ECN/feature-implement-multiparsing-when-l…

c88dc30

…oading-multiple-queues-and-items Add support for multi-threadded Queue loading

Simplify config overrides and change config ext

462182d

Fix config environment reference

1600b7c

Remove testing config and rename config ext

0c4523f

Merge pull request #46 from ECN/feature-implement-config-file-overrid…

f4f874e

…e-for-webqueue2api-configs Feature implement config file override for webqueue2api configs

Add basic validation for parser settings in config file

1ca7251

Update docs

c73052c

Rebuild docs

44e97cf

campb303 merged commit c648873 into master Aug 3, 2021

v1.1 RC #47

v1.1 RC #47

Conversation

campb303 commented Aug 3, 2021