Skip to content

Commit a25d58c

Browse files
andrewkhoandrewkho
authored
Update state_dict() request at time 0 to include worker state
Differential Revision: D57805075 Pull Request resolved: meta-pytorch#1260
1 parent 82918dd commit a25d58c

File tree

7 files changed

+503
-89
lines changed

7 files changed

+503
-89
lines changed

‎.github/workflows/ci.yml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -76,6 +76,7 @@ jobs:
7676
- name: Install test requirements
7777
run: pip3 install -r test/requirements.txt
7878
- name: Test documentation examples
79+
if: matrix.os != 'windows-latest'
7980
run: |
8081
cd ./docs
8182
pip3 install -r requirements.txt

‎.github/workflows/stateful_dataloader_ci.yml‎

Lines changed: 1 addition & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -72,15 +72,9 @@ jobs:
7272
run: |
7373
pip3 install .
7474
env:
75-
BUILD_S3: 1
75+
BUILD_S3: 0
7676
- name: Install test requirements
7777
run: pip3 install -r test/requirements.txt
78-
- name: Test documentation examples
79-
run: |
80-
cd ./docs
81-
pip3 install -r requirements.txt
82-
make doctest
83-
cd ..
8478
- name: Run StatefulDataLoader tests with pytest - dataloader
8579
if: ${{ ! contains(github.event.pull_request.labels.*.name, 'ciflow/slow') }}
8680
run: pytest --durations=0 --no-header -v test/stateful_dataloader/test_dataloader.py

‎test/stateful_dataloader/test_incremental_state.py‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@
1010
import torch
1111

1212
from torch.testing._internal.common_utils import TestCase
13-
from torchdata.stateful_dataloader import (
13+
from torchdata.stateful_dataloader.incremental_state import (
1414
_DATASET_ITER_STATE,
1515
_DATASET_STATE,
1616
_FETCHER_ENDED,

0 commit comments

Comments
 (0)