我正在做一个对每个变量进行编码的神经网络,当我要拟合模型时,会引发错误。
indices[201] = [0,8] is out of order. Many sparse ops require sorted indices.
Use `tf.sparse.reorder` to create a correctly ordered copy.
[Op:SerializeManySparse]
我不知道如何解决。我可以在这里打印一些代码,如果您想要更多,我仍然可以打印它
def process_atributes(df, train, test):
continuas = ['Trip_Duration']
cs = MinMaxScaler()
trainCont = cs.fit_transform(train[continuas])
testCont = cs.transform(test[continuas])
discretas = ['Start_Station_Name', 'End_Station_Name', 'User_Type', 'Genero', 'Hora_inicio']
ohe = OneHotEncoder()
ohe.fit(train[discretas])
trainDisc = ohe.transform(train[discretas])
testDisc = ohe.transform(test[discretas])
trainX = sc.sparse.hstack((trainDisc, trainCont))
testX = sc.sparse.hstack((testDisc, testCont))
return (trainX, testX)
def prepare_targets(df, train, test):
labeled_col = ['RangoEdad']
le = LabelEncoder()
le.fit(train[labeled_col].values.ravel())
trainY = le.transform(train[labeled_col])
testY = le.transform(test[labeled_col])
return trainY, testY
X_train_enc, X_test_enc = process_atributes(dataFrameDepurado2, train, test)
Y_train_enc, Y_test_enc = prepare_targets(dataSetPrueba, train, test)
model = Sequential()
model.add(Dense(10, input_dim = X_train_enc.shape[1], activation = 'tanh', kernel_initializer = 'he_normal'))
model.add(Dense(4, activation = 'sigmoid'))
model.compile(loss = 'sparse_categorical_crossentropy', optimizer = SGD(lr = 0.01), metrics = ['accuracy'])
model.fit(X_train_enc, Y_train_enc, validation_data = (X_test_enc, Y_test_enc), epochs = 20, batch_size = 64, shuffle = True)
这是我的数据集
谢谢你。
即使在评论部分中也有提及此解决方案(答案部分)的原因,这是社区的利益。
SparseTensor状态的文档
By convention, indices should be sorted in row-major order (or equivalently
lexicographic order on the tuples indices[i]). This is not enforced when
SparseTensor objects are constructed, but most ops assume correct ordering. If
the ordering of sparse tensor st is wrong, a fixed version can be obtained by
calling [tf.sparse.reorder(st)][2].
因此,在代码行之前在矩阵tf.sparse.reorder
上使用scipy.sort_indices
或X_train_enc, X_test_enc, Y_train_enc, Y_test_enc
,>
model.fit(X_train_enc, Y_train_enc, validation_data = (X_test_enc, Y_test_enc), epochs = 20, batch_size = 64, shuffle = True)
将解决问题。
有关更多信息,请参阅Sparse Tensor和tf.sparse.reorder的文档。
希望这会有所帮助。祝您学习愉快!