FAQ
| This is a
LIVE
service |
Changelog
Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
ews-coordinator
Manage
Activity
Members
Code
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Locked files
Deploy
Releases
Package registry
Container Registry
Operate
Terraform modules
Analyze
Contributor analytics
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Terms and privacy
Keyboard shortcuts
?
Snippets
Groups
Projects
Admin message
GitLab has been upgraded. See what's new in the
Changelog
.
Show more breadcrumbs
Gilligan Lab for Epidemiology and Modelling
Wheat rusts
ews-coordinator
Commits
f926992e
Commit
f926992e
authored
1 year ago
by
J.W. Smith
Browse files
Options
Downloads
Patches
Plain Diff
refactior: Adaptable query of past job successes
parent
302d195f
No related branches found
Branches containing commit
No related tags found
No related merge requests found
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
coordinator/ProcessorUtils.py
+21
-22
21 additions, 22 deletions
coordinator/ProcessorUtils.py
with
21 additions
and
22 deletions
coordinator/ProcessorUtils.py
+
21
−
22
View file @
f926992e
...
...
@@ -260,6 +260,25 @@ def query_proceed(necessary_file,description):
return
True
def
query_component_success
(
config_i
,
job_run
:
str
,
job_to_check
:
str
):
'''
Checks if a coordinator jobs has already completed successfully. If not,
it raises an error.
'''
# check if deposition data is readily available
dep_success_file
=
Template
(
config_i
[
job_run
][
job_to_check
][
'
SuccessFileTemplate
'
]).
substitute
(
**
config_i
)
try
:
query_proceed
(
dep_success_file
,
'
deposition
'
)
except
:
if
'
AlternativeSuccessFileTemplate
'
not
in
config_i
[
job_run
][
job_to_check
]:
logger
.
warning
(
f
"
No AlternativeSuccessFileTemplate to check for
"
)
endScript
(
premature
=
True
)
dep_success_file_alt
=
Template
(
config_i
[
job_run
][
job_to_check
][
'
AlternativeSuccessFileTemplate
'
]).
substitute
(
**
config_i
)
query_proceed
(
dep_success_file_alt
,
job_to_check
.
lower
())
return
True
def
query_past_successes
(
input_args
:
dict
):
'''
Checks if deposition and environment jobs are already completed
successfully. If not, it raises an error.
'''
...
...
@@ -279,29 +298,9 @@ def query_past_successes(input_args: dict):
config_i
[
'
StartString
'
]
=
input_args
[
'
start_date
'
]
# check if deposition data is readily available
dep_success_file
=
Template
(
config_i
[
component
][
'
Deposition
'
][
'
SuccessFileTemplate
'
]).
substitute
(
**
config_i
)
try
:
query_proceed
(
dep_success_file
,
'
deposition
'
)
except
:
if
'
AlternativeSuccessFileTemplate
'
not
in
config_i
[
component
][
'
Deposition
'
]:
logger
.
warning
(
f
"
No AlternativeSuccessFileTemplate to check for
"
)
endScript
(
premature
=
True
)
dep_success_file_alt
=
Template
(
config_i
[
component
][
'
Deposition
'
][
'
AlternativeSuccessFileTemplate
'
]).
substitute
(
**
config_i
)
query_proceed
(
dep_success_file_alt
,
'
deposition
'
)
query_component_success
(
config_i
,
component
,
'
Deposition
'
)
# check if environment data is readily available
env_success_file
=
Template
(
config_i
[
component
][
'
Environment
'
][
'
SuccessFileTemplate
'
]).
substitute
(
**
config_i
)
try
:
query_proceed
(
env_success_file
,
'
environment
'
)
except
:
if
'
AlternativeSuccessFileTemplate
'
not
in
config_i
[
component
][
'
Environment
'
]:
logger
.
warning
(
f
"
No AlternativeSuccessFileTemplate to check for
"
)
endScript
(
premature
=
True
)
env_success_file_alt
=
Template
(
config_i
[
component
][
'
Environment
'
][
'
AlternativeSuccessFileTemplate
'
]).
substitute
(
**
config_i
)
query_proceed
(
env_success_file_alt
,
'
environment
'
)
query_component_success
(
config_i
,
component
,
'
Environment
'
)
return
True
\ No newline at end of file
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment