Commit 518d9db
Launch v1 (#66)
* Add autogenerated client into launch v1 (#63)
* add autogenerated client into launch v1
* flake8 conf
* pylint and mypy too
* isort
* Squashed commit of the following:
commit 9533e47
Author: phil-scale <phil.chen@scale.com>
Date: Mon Dec 19 23:12:49 2022 -0800
update deps
commit 14d1f11
Author: phil-scale <phil.chen@scale.com>
Date: Mon Dec 19 23:07:38 2022 -0800
fix pylint check
commit f6c159d
Author: phil-scale <phil.chen@scale.com>
Date: Mon Dec 19 23:05:20 2022 -0800
fix
commit 26825f6
Author: phil-scale <phil.chen@scale.com>
Date: Mon Dec 19 22:58:44 2022 -0800
fix tests
commit f2c0db8
Merge: 443cb0c 7bdf37b
Author: phil-scale <phil.chen@scale.com>
Date: Mon Dec 19 14:33:23 2022 -0800
Merge remote-tracking branch 'origin/master' into phil/launch-v1
commit 443cb0c
Author: Phil Chen <phil.chen@scale.com>
Date: Wed Dec 14 21:58:33 2022 -0800
fix
commit 7dee94f
Author: Phil Chen <phil.chen@scale.com>
Date: Wed Dec 14 18:27:13 2022 -0800
fixes
commit 44efbf4
Author: Phil Chen <phil.chen@scale.com>
Date: Fri Dec 2 12:13:55 2022 -0800
fix
commit 7b74884
Author: Phil Chen <phil.chen@scale.com>
Date: Fri Dec 2 11:03:45 2022 -0800
fix
commit 451de71
Author: Phil Chen <phil.chen@scale.com>
Date: Fri Dec 2 01:05:26 2022 -0800
basic auth and fixes
commit 607332e
Author: Phil Chen <phil.chen@scale.com>
Date: Thu Dec 1 14:47:43 2022 -0800
update reqs
commit ce11dff
Author: Phil Chen <phil.chen@scale.com>
Date: Thu Dec 1 14:40:10 2022 -0800
black
commit ae4e040
Author: Phil Chen <phil.chen@scale.com>
Date: Thu Dec 1 14:38:29 2022 -0800
fix mypy
commit 58c62ce
Author: Phil Chen <phil.chen@scale.com>
Date: Thu Dec 1 14:34:14 2022 -0800
change to deployment_state
commit a582155
Merge: ff24539 aa0c0b2
Author: Phil Chen <phil.chen@scale.com>
Date: Thu Dec 1 14:29:16 2022 -0800
Merge branch 'launch-v1' into phil/launch-v1
commit aa0c0b2
Author: Phil Chen <92065453+phil-scale@users.noreply.github.com>
Date: Thu Dec 1 14:28:48 2022 -0800
Add autogenerated client into launch v1 (#63)
* add autogenerated client into launch v1
* flake8 conf
* pylint and mypy too
* isort
commit ff24539
Author: Phil Chen <phil.chen@scale.com>
Date: Thu Dec 1 14:28:15 2022 -0800
address comment
commit a53c23d
Author: Phil Chen <phil.chen@scale.com>
Date: Thu Dec 1 09:25:55 2022 -0800
black
commit b5d4787
Author: Phil Chen <phil.chen@scale.com>
Date: Thu Dec 1 09:14:52 2022 -0800
launch v1 client updates
* fixes
* Use new autogenerated python client for v1 (#67)
* Phil/upload schemas (#68)
* update client
* try again
* fix import
* fixes
* wip
* fixes
* try fix again
* fix
* fixes
* add pydantic schema support
* add test
* fix
* fix flat schemas
* black and isort
* Launch v1 client updates for batch jobs and callbacks (#69)
* add autogen client
* update client to use new API for callbacks and batch jobs
* fix
* Update clone-bundle route (#70)
* Update clone bundle function
* Revert unnecessary change
* pr comments
* mypy
* black
* ✨ Updated v1 CLI ✨ (#71)
* updated v1 python client
* specify encoding
* use utf-8
* add ID to list endpoints and get endpoint
* Use spinner while loading in cli and edit endpoints from CLI (#72)
* clone_bundle_with_changes server route expects new_app_config, not app_config
* update reqs
* use base64 and json to encode batch job payloads (#74)
* fix base64 encoding
* Add CLI command for getting batch job status (#75)
* Use timedelta for printing batch job duration
* fix sync endpoint request
* fix sync endpoint result on error
* Add timeouts to `EndpointResponseFuture` (#77)
* Send requests to launch endpoint (#76)
Adding `send` command, ie: `launch tasks send`
* print more info in launch CLI
* Clean up unused code and use ruff instead of flake8 (#79)
* use ruff instead of flake8
* update lint cfgs
* fix typing
* rm pipeline test
* Add features to `launch endpoints list` (#80)
* add orderby, descending and num_gpus
* reverting changes
* typing_extensions for py37
* remove double print (#82)
* filter bundles and endpoints by name in CLI (#84)
* New documentation site (#81)
* Use mkdocs and write docs for launch
* updates
* add site_url
* add overview of concepts
* fix
* some more fixes
* Update CLI help string to 118 instead of 78 chars wide
* test python code in docs and docstrings
* update team tags to infra
* update literal to typing_extensions
* add some reqs
* fix
* add sleep to callbacks
* updates
* update deps
* address comments
* fix pylint
* Callback custom auth (#85)
* update clients
* Update client to support custom callback auth
* update docs
* update docs with mtls default example
* add copy extension
* Add endpoint to client
* Update docs and external client for priority API change (#87)
* new docs
* format
* format isort
* new changes
* new formatted changes
* formatting
* updated client
* changing from str to bool
* removing site
* making sure?
* update to v1
* Update autogen client with v2 bundles (#88)
* Update autogenerated python client
* fix tests
* Model bundles v2 python API (#89)
* Add model bundles v2 API
* add get list and clone routes too
* use types and make docstrings more informative
* fixes
* fix status
* Documentation for model bundles v2 (#90)
* Add documentation for model bundles
* address comments
* fix
* launch v2 bundles API (#91)
* v2 bundles api copy
* Formated with black
* isort and fix 2 mypy errors
launch/connection.py:14: error: Incompatible default for argument "endpoint" (default has type "None", argument has type "str") [assignment]
launch/client.py:1811: error: Incompatible default for argument "urls" (default has type "None", argument has type "List[str]") [assignment]
* Fix package import
* Added readiness_initial_delay_seconds
* updating docs
* Added create TritonEnhancedRunnableImageFlavor bundle
* fix
* fix
* fix
* rm space
* update docs
* fix index docs to new apis
---------
Co-authored-by: Phil Chen <phil.chen@scale.com>
* update mkdocs readme
* use logging lib
---------
Co-authored-by: Yi Xu <yi.xu@scale.com>
Co-authored-by: Adrian Lam <72415932+adlam-scale@users.noreply.github.com>
Co-authored-by: Anirudh Jain <88404749+Anirudh-Scale@users.noreply.github.com>
Co-authored-by: Malcolm Greaves <malcolmgreaves@users.noreply.github.com>1 parent 7bdf37b commit 518d9db
File tree
382 files changed
+46369
-53844
lines changed- .circleci
- docs
- _static
- css
- scripts
- styles
- api
- launch
- clientlib
- batching
- implementation
- named_arrays
- single_array
- types
- core
- demonstration
- deployment
- exe
- run_service
- full_service
- http
- loader
- model_service
- implementation
- named_arrays
- single_array
- types
- model
- object_conf_from_std_ml_serve
- pipeline
- service
- triton
- types
- utils
- client
- cli
- bin
- bundles
- client
- endpoints
- connection
- constants
- errors
- find_packages
- hooks
- logger
- make_batch_file
- model_bundle
- model_endpoint
- pipeline
- deployment
- runtime
- service
- utils
- request_validation
- retry_strategy
- utils
- concepts
- guides
- launch
- api_client
- apis
- paths
- tags
- models
- model
- paths
- healthcheck
- healthz
- readyz
- v1_async_tasks_task_id
- v1_async_tasks
- v1_batch_jobs_batch_job_id
- v1_batch_jobs
- v1_model_bundles_clone_with_changes
- v1_model_bundles_latest
- v1_model_bundles_model_bundle_id
- v1_model_bundles
- v1_model_endpoints_api
- v1_model_endpoints_model_endpoint_id
- v1_model_endpoints_schema_json
- v1_model_endpoints
- v1_sync_tasks
- v2_model_bundles_clone_with_changes
- v2_model_bundles_latest
- v2_model_bundles_model_bundle_id
- v2_model_bundles
- clientlib
- batching
- exe
- model_service
- cli
- pipeline
- tests
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
382 files changed
+46369
-53844
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
40 | 40 | | |
41 | 41 | | |
42 | 42 | | |
43 | | - | |
| 43 | + | |
44 | 44 | | |
45 | | - | |
| 45 | + | |
46 | 46 | | |
47 | 47 | | |
48 | 48 | | |
49 | | - | |
50 | | - | |
| 49 | + | |
| 50 | + | |
51 | 51 | | |
52 | 52 | | |
53 | | - | |
54 | | - | |
| 53 | + | |
| 54 | + | |
55 | 55 | | |
56 | 56 | | |
57 | 57 | | |
| |||
This file was deleted.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
| |||
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
14 | | - | |
15 | | - | |
| 14 | + | |
| 15 | + | |
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
27 | 27 | | |
28 | 28 | | |
29 | 29 | | |
30 | | - | |
| 30 | + | |
| 31 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
61 | 61 | | |
62 | 62 | | |
63 | 63 | | |
64 | | - | |
| 64 | + | |
| 65 | + | |
65 | 66 | | |
66 | 67 | | |
67 | 68 | | |
68 | 69 | | |
69 | 70 | | |
70 | | - | |
71 | | - | |
| 71 | + | |
72 | 72 | | |
73 | 73 | | |
74 | | - | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
This file was deleted.
0 commit comments