AgnostiqHQ/covalent: v0.232.0

[0.232.0] - 2024-01-10 Authors Ara Ghukasyan 38226926+araghukas@users.noreply.github.com Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Andrew S. Rosen asrosen93@gmail.com Co-authored-by: Will Cunningham wjcunningham7@users.noreply.github.com Co-authored-by: Sankalp Sanand sankalp@agnostiq.ai Kevin Taylor tkdtaylor@gmail.com FilipBolt filipbolt@gmail.com Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Will Cunningham wjcunningham7@gmail.com Co-authored-by: Prasy12 prasanna.venkatesh@psiog.com Aviral Katiyar 123640350+maskboyAvi@users.noreply.github.com Co-authored-by: ArunPsiog arun.mukesh@psiog.com Casey Jao casey@agnostiq.ai Arnav Kohli 95236897+THEGAMECHANGER416@users.noreply.github.com Kirill Pushkarev 71515921+kirill-push@users.noreply.github.com Aditya Raj Kashyap 95625520+AdityaRaj23@users.noreply.github.com ArunPsiog 106462226+ArunPsiog@users.noreply.github.com mpvgithub 107603631+mpvgithub@users.noreply.github.com Aravind 100823292+Aravind-psiog@users.noreply.github.com Faiyaz Hasan faiyaz@agnostiq.ai Co-authored-by: Venkat Bala balavk89@gmail.com Co-authored-by: kessler-frost ssanand@hawk.iit.edu Co-authored-by: Aravind-psiog aravind.prabaharan@psiog.com Co-authored-by: Manjunath PV manjunath.poilath@psiog.com Co-authored-by: Ara Ghukasyan ara@agnostiq.ai Co-authored-by: Alejandro Esquivel ae@alejandro.ltd Co-authored-by: jackbaker1001 jsbaker1001@gmail.com Co-authored-by: Santosh kumar 29346072+santoshkumarradha@users.noreply.github.com Co-authored-by: Will Cunningham will@agnostiq.ai Co-authored-by: sriranjani venkatesan sriranjani.venkatesan@psiog.com Co-authored-by: Prasanna Venkatesh 54540812+Prasy12@users.noreply.github.com WingCode smallstar1234@gmail.com Nick Tyler nicholas.s.tyler.4@gmail.com Co-authored-by: RaviPsiog raviteja.gurram@psiog.com dwelsch-esi 116022979+dwelsch-esi@users.noreply.github.com Co-authored-by: dwelsch-memverge david.welsch@memverge.com Madhur Tandon 20173739+madhur-tandon@users.noreply.github.com Co-authored-by: kamalesh.suresh kamalesh.suresh@psiog.com Co-authored-by: santoshkumarradha santosh@agnostiq.ai Janosh Riebesell janosh.riebesell@gmail.com Madhur Tandon madhurtandon23@gmail.com Rob de Wit RCdeWit@users.noreply.github.com Venkat Bala 15014089+venkatBala@users.noreply.github.com Co-authored-by: Venkat Bala venkat@agnostiq.ai Co-authored-by: Amalan Jenicious F amalan.jenicious@psiog.com RaviPsiog 111348352+RaviPsiog@users.noreply.github.com Co-authored-by: RaviPsiog ravieja.gurram@psiog.com Akalanka 8133713+boneyag@users.noreply.github.com Co-authored-by: Scott Wyman Neagle scott@agnostiq.ai Scott Wyman Neagle wymnea@protonmail.com Added check for /bin/bash AND /bin/sh (in that order) to execute bash leptons Programmatic equivalents of CLI commands covalent start and covalent stop Documentation and test cases for database triggers. Added the __pow__ method to the Electron class New Runner and executor API to bypass server-side memory when running tasks. Added qelectron_db as an asset to be transferred from executor's machine to covalent server New methods to qelectron_utils, replacing the old ones Covalent deploy CLI tool added - allows provisioning infras directly from covalent Added a py.typed file to support type-checking Corrected support from distributed Hamiltonian expval calculations Exposed qelectron db in sdk result object UI changes added for qelectrons and fix for related config file corruption UI fix regarding Qelectron not showing up Performance optimisation of UI for large Qelectrons File transfer strategy for GCP storage Add CLI status for zombie, stopped process. Fix for double locking file in configurations. Introduced new data access layer Introduced Shutil file transfer strategy for local file transfers File transfer strategy for Azure blob storage executor property to Electron class, allowing updation of executor after electron function definition Added ability to hide post-processing electrons on the UI. Added prettify of names for the graph screen on the UI. Ability to specify a workdir for local and dask executors along with create_unique_workdir option for each electron / node. Heartbeat file is created and updated when the server is running Added SQLiteTrigger class to the triggers module. Added the CloudResourceManager class A new tutorial for a dynamic quantum chemistry workflow Tutorial for hybrid neural network using Covalent, AWSBatch, and Qiskit Runtime. Environment variable that users can set to specify the location where Covalent can find their defined executors. Task group id in Electrons. Reconstruct postprocessing method. Postprocessing as electrons. Postprocessing class in postprocessing.py module for all the different postprocessing helper methods and algorithms. disable_run option added to enable "saving-only" option on covalent server and not executing the workflow register_triggers, stop_triggers functions added to LocalDispatcher class triggers parameter to the lattice metadata BaseTrigger, DirTrigger, TimeTrigger classes added available to be assigned to any lattice enabling the triggers feature TriggerLoader class added enabling loading of any kind of triggers including user defined ones without requiring installation CLI options to start covalent server in triggers only, and no triggers mode is_pending option added during redispatch to resume execution of a previously "saved-only", i.e pending workflow API routes added for Triggers server Added feature to support cancelling workflow dispatches Updating/adding new tests to improve code coverage API endpoint for redispatching. Unit and functional tests for redispatching. TransportGraphOps class for diffing operations on transport graphs. Added make derived dispatch method. Apply electron updates method to _TransportGraph. Workflow re-dispatching functionality. Added dispatcher_addr argument to ct.get_result similar to ct.dispatch so that it doesn't always fallback to using the default configured address Front-end pending unit tests for the GUI. Adding support for PostgresQL DB backend Added check for COVALENT_DATABASE_URL, if exists connect sqlalchemy engine using that Adding COVALENT_DATABASE_USER and COVALENT_DATABASE_PASSWORD environment variables Adding COVALENT_DATABASE_HOSTNAME and COVALENT_DATABASE_PORT environment variables for easy configuration Added TaskRuntimeError exception for executor plugin implementations to signal to Covalent that a task raised an unhandled exception while running in the executor backend. Added environment variable for a remote database backend Added support for mysql and postgresql Support for transferring the contents of folders to and from S3 buckets using the file transfer module. RTD for User Interface Minor GUI fixes Ability to use terminal on the GUI. Changed Terraform output to use scrolling buffer. Terraform output handling to show errors. Bumped up babel/traverse version to 7.23.2 Changed the axios version on the webapp side. Changed the azurebatch.rst banner from default covalent jpg to azure batch's svg file [Significant Changes] Improving memory management part 1/3 Removed strict version pins on lmdbm, mpire, orjson, and pennylane Changed license to Apache Improved error handling in generate_docs.py [Significant Changes] Migrated core server-side code to new data access layer. Changed the way UI was accessing the qelectron database to access it directly from the mdb file in object store Update version of browserverify-sign Limiting cloudpickle version to less than 3.0 for now Raised the minimum version of Pydantic from 1.10.1 to 2.1.1 in requirements.txt Electron DAL to use Covalent server's data instead of QServer's data. Renamed QCluster's selector_serialized attribute so it gets propagated to the qserver. Removed orm_mode = True in covalent_ui/api/v1/models/dispatch_model.py as it is deprecated in Pydantic 2 Removed the upper limit from dask and distributed packages' versions until we find a version which is incompatible with Covalent. When the server is stopped, any workflows in a non-terminal state are first cancelled Pinned sqlalchemy version with upper limit <2.0.0. Added rich support to cli for better printing statements. Performed minor modifications and rearrangementsto fix the broken tests in the nightly workflow. Reverting nightly frequency back to midnight basis Temporarily changing the nightly frequency to every hour Error messages are propagated to stdout when the server is not started. These changes are applied to dispatch, redispatch, and get_result. Implementation of TransportableObject property method to be backwards compatible with version 0.209.1. Moved TransportableObject from transport.py to a new file transportable_object.py. Postprocessing logic. Sublattice logic. Sublattices are now treated as electrons. Once the transport graph has been built, the status get changed to DISPATCHING at which point it is executed as another workflow. Modified ct.get_result to allow for status only requests Enhanced the Dockerfile to include builds from various sources and a differentiation between SDK and Server builds Location of function to load result from the database now moved to load module in covalent_dispatcher/_db folde. Changed decode-uri-component package version on webapp yarn-lock file. Changed json5 package version on webapp yarn-lock file. Reverted nightly frequency back to once a day Updated requirements.txt to include pyscopg2 Refactored execution.py into loosely coupled modular pieces Updated directory like default environment variable paths to avoid creating redundant nested directories when self-hosting Docs for Covalent's Slurm plugin updated with explanation for optional srun parameters. Electron errors are segregated by type; task runtim

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.