Skip to content

Convert sparse labels to pandas series #1059

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
mfeurer merged 8 commits into from
Apr 26, 2021
Merged

Convert sparse labels to pandas series #1059

Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
e9a2e33
Convert sparse labels to pandas series
Neeratyoy Apr 15, 2021
1ae89f5
Handling sparse labels as Series
Neeratyoy Apr 19, 2021
244d9bb
Handling sparse targets when dataset as arrays
Neeratyoy Apr 21, 2021
2bb085a
Merge branch 'develop' into fix_1057
Neeratyoy Apr 21, 2021
fad916c
Revamping sparse dataset tests
Neeratyoy Apr 22, 2021
2170c72
Removing redundant unit test
Neeratyoy Apr 22, 2021
97fa8c7
Cleaning target column formatting
Neeratyoy Apr 23, 2021
b63eac9
Minor comment edit
Neeratyoy Apr 26, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Handling sparse targets when dataset as arrays
  • Loading branch information
@Neeratyoy
Neeratyoy committed Apr 21, 2021
commit 244d9bb66aa25acfe4c31f9e292ffe9896bfc1f8
3 changes: 3 additions & 0 deletions openml/datasets/dataset.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -755,6 +755,9 @@ def get_data(
attribute_names = [att for att, k in zip(attribute_names, targets) if not k]

x = self._convert_array_format(x, dataset_format, attribute_names)
if dataset_format == "array" and scipy.sparse.issparse(y):
# scikit-learn requires dense representation of targets
y = np.asarray(y.todense()).astype(target_dtype)
if not scipy.sparse.issparse(y):
y = y.squeeze()
y = self._convert_array_format(y, dataset_format, target_names)
Expand Down