2021-12-18 17:50:20,912 : WARN  : ModalContext :  : Node : RowID : 15:50:64:59 : No row key column selected generate a new one
2021-12-18 17:50:20,917 : WARN  : ModalContext :  : Node : One to Many : 15:50:61 : Possible value domain for column "Actual Digit" is empty, use the Domain Calculator node (with a sufficient possible value limit) to create it.
2021-12-18 17:50:21,017 : WARN  : ModalContext :  : Node : RowID : 15:51:61:59 : No row key column selected generate a new one
2021-12-18 17:50:32,228 : WARN  : KNIME-Worker-62-List Files (deprecated) 15:50:51 :  : Node : RowID : 15:50:64:59 : No row key column selected generate a new one
2021-12-18 17:50:32,525 : WARN  : KNIME-Worker-53-String To Number (deprecated) 15:50:64:58 :  : Node : RowID : 15:50:64:59 : No row key column selected generate a new one
2021-12-18 17:50:32,584 : WARN  : KNIME-Worker-54-Sorter 15:50:64:57 :  : Node : RowID : 15:50:64:59 : No row key column selected generate a new one
2021-12-18 17:50:33,805 : WARN  : ModalContext :  : Node : RowID : 16:50:64:59 : No row key column selected generate a new one
2021-12-18 17:50:33,808 : WARN  : ModalContext :  : Node : One to Many : 16:50:61 : Possible value domain for column "Actual Digit" is empty, use the Domain Calculator node (with a sufficient possible value limit) to create it.
2021-12-18 17:50:33,882 : WARN  : ModalContext :  : Node : RowID : 16:51:61:59 : No row key column selected generate a new one
2021-12-18 17:57:24,466 : WARN  : KNIME-Worker-72-List Files (deprecated) 15:51:51 :  : Node : RowID : 15:51:61:59 : No row key column selected generate a new one
2021-12-18 17:57:24,479 : WARN  : KNIME-Worker-74-String To Number (deprecated) 15:51:61:58 :  : Node : RowID : 15:51:61:59 : No row key column selected generate a new one
2021-12-18 17:57:24,483 : WARN  : KNIME-Worker-75-Sorter 15:51:61:57 :  : Node : RowID : 15:51:61:59 : No row key column selected generate a new one
2021-12-18 17:57:24,907 : WARN  : Thread-108 :  : PythonKernel : Keras Network Learner : 15:89 : C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\models.py:282: UserWarning: No training configuration found in save file: the model was *not* compiled. Compile it manually.
2021-12-18 18:12:21,557 : ERROR : KNIME-Worker-69-Keras Network Learner 15:89 :  : DLKerasLearnerNodeModel : Keras Network Learner : 15:89 : Blas GEMM launch failed : a.shape=(10000, 128), b.shape=(128, 10), m=10000, n=10, k=128
	 [[Node: dense_2/MatMul = MatMul[T=DT_FLOAT, _class=["loc:@training/Adadelta/gradients/dropout_2/cond/Merge_grad/cond_grad"], transpose_a=false, transpose_b=false, _device="/job:localhost/replica:0/task:0/device:GPU:0"](dropout_2/cond/Merge, dense_2/kernel/read)]]
	 [[Node: metrics/acc/Mean_1/_125 = _Recv[client_terminated=false, recv_device="/job:localhost/replica:0/task:0/device:CPU:0", send_device="/job:localhost/replica:0/task:0/device:GPU:0", send_device_incarnation=1, tensor_name="edge_899_metrics/acc/Mean_1", tensor_type=DT_FLOAT, _device="/job:localhost/replica:0/task:0/device:CPU:0"]()]]

Caused by op 'dense_2/MatMul', defined at:
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\PythonKernelLauncher.py", line 122, in <module>
    kernel.start()
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\python3\PythonKernel.py", line 88, in start
    self.execute_thread_executor.start()
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\python3\_QueuedExecutor.py", line 87, in start
    work_item.run()
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\concurrent\futures\thread.py", line 55, in run
    result = self.fn(*self.args, **self.kwargs)
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\python3\_QueuedExecutor.py", line 108, in _monitored_fn
    return fn(*args, **kwargs)
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\messaging\Task.py", line 179, in run
    self._runnable()
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\messaging\Task.py", line 143, in _run_internal
    received, self._message_handlers, self._message_id_supplier, self._set_result, self._workspace)
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\messaging\AbstractTaskHandler.py", line 76, in handle
    if self._handle_custom_message(message, message_id_supplier, message_to_send, result_consumer, workspace):
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\messaging\RequestHandlers.py", line 96, in _handle_custom_message
    response = self._respond(message, response_message_id, workspace)
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\messaging\RequestHandlers.py", line 376, in _respond
    output, error = workspace.execute(source_code, request.id)
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\PythonKernelBase.py", line 289, in execute
    exec(source_code, self._exec_env, self._exec_env)
  File "<string>", line 3, in <module>
  File "C:\Program Files\KNIME\plugins\org.knime.dl.keras_4.3.0.v202012011122\py\DLTF2NetworkReader.py", line 126, in read
    return read_keras(self.backend, path, compile, compatibility_mode)
  File "C:\Program Files\KNIME\plugins\org.knime.dl.keras_4.3.0.v202012011122\py\DLTF2NetworkReader.py", line 92, in read_keras
    }[backend](path, compile, compatibility_mode)
  File "C:\Program Files\KNIME\plugins\org.knime.dl.keras_4.3.0.v202012011122\py\DLTF2NetworkReader.py", line 98, in read_keras_tensorflow
    compatibility_mode=compatibility_mode)
  File "C:\Program Files\KNIME\plugins\org.knime.dl.keras_4.3.0.v202012011122\py\DLKerasTensorFlowNetwork.py", line 60, in read
    model = self._read_internal(path, compile)
  File "C:\Program Files\KNIME\plugins\org.knime.dl.keras_4.3.0.v202012011122\py\DLKerasNetwork.py", line 100, in _read_internal
    return load_model(path, compile=compile)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\models.py", line 270, in load_model
    model = model_from_config(model_config, custom_objects=custom_objects)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\models.py", line 347, in model_from_config
    return layer_module.deserialize(config, custom_objects=custom_objects)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\layers\__init__.py", line 55, in deserialize
    printable_module_name='layer')
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\utils\generic_utils.py", line 144, in deserialize_keras_object
    list(custom_objects.items())))
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\engine\topology.py", line 2535, in from_config
    process_node(layer, node_data)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\engine\topology.py", line 2492, in process_node
    layer(input_tensors[0], **kwargs)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\engine\topology.py", line 619, in __call__
    output = self.call(inputs, **kwargs)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\layers\core.py", line 877, in call
    output = K.dot(inputs, self.kernel)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\backend\tensorflow_backend.py", line 1076, in dot
    out = tf.matmul(x, y)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\tensorflow\python\ops\math_ops.py", line 2018, in matmul
    a, b, transpose_a=transpose_a, transpose_b=transpose_b, name=name)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\tensorflow\python\ops\gen_math_ops.py", line 4456, in mat_mul
    name=name)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\tensorflow\python\framework\op_def_library.py", line 787, in _apply_op_helper
    op_def=op_def)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\tensorflow\python\util\deprecation.py", line 454, in new_func
    return func(*args, **kwargs)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\tensorflow\python\framework\ops.py", line 3155, in create_op
    op_def=op_def)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\tensorflow\python\framework\ops.py", line 1717, in __init__
    self._traceback = tf_stack.extract_stack()

InternalError (see above for traceback): Blas GEMM launch failed : a.shape=(10000, 128), b.shape=(128, 10), m=10000, n=10, k=128
	 [[Node: dense_2/MatMul = MatMul[T=DT_FLOAT, _class=["loc:@training/Adadelta/gradients/dropout_2/cond/Merge_grad/cond_grad"], transpose_a=false, transpose_b=false, _device="/job:localhost/replica:0/task:0/device:GPU:0"](dropout_2/cond/Merge, dense_2/kernel/read)]]
	 [[Node: metrics/acc/Mean_1/_125 = _Recv[client_terminated=false, recv_device="/job:localhost/replica:0/task:0/device:CPU:0", send_device="/job:localhost/replica:0/task:0/device:GPU:0", send_device_incarnation=1, tensor_name="edge_899_metrics/acc/Mean_1", tensor_type=DT_FLOAT, _device="/job:localhost/replica:0/task:0/device:CPU:0"]()]]

2021-12-18 18:12:21,557 : ERROR : KNIME-Worker-69-Keras Network Learner 15:89 :  : Node : Keras Network Learner : 15:89 : Execute failed: An error occured during training of the Keras deep learning network. See log for details.
java.lang.RuntimeException: An error occured during training of the Keras deep learning network. See log for details.
	at org.knime.dl.keras.base.nodes.learner.DLKerasLearnerNodeModel.handleGeneralException(DLKerasLearnerNodeModel.java:744)
	at org.knime.dl.keras.base.nodes.learner.DLKerasLearnerNodeModel.executeInternal(DLKerasLearnerNodeModel.java:719)
	at org.knime.dl.keras.base.nodes.learner.DLKerasLearnerNodeModel.execute(DLKerasLearnerNodeModel.java:321)
	at org.knime.core.node.NodeModel.executeModel(NodeModel.java:576)
	at org.knime.core.node.Node.invokeFullyNodeModelExecute(Node.java:1245)
	at org.knime.core.node.Node.execute(Node.java:1025)
	at org.knime.core.node.workflow.NativeNodeContainer.performExecuteNode(NativeNodeContainer.java:558)
	at org.knime.core.node.exec.LocalNodeExecutionJob.mainExecute(LocalNodeExecutionJob.java:95)
	at org.knime.core.node.workflow.NodeExecutionJob.internalRun(NodeExecutionJob.java:201)
	at org.knime.core.node.workflow.NodeExecutionJob.run(NodeExecutionJob.java:117)
	at org.knime.core.util.ThreadUtils$RunnableWithContextImpl.runWithContext(ThreadUtils.java:334)
	at org.knime.core.util.ThreadUtils$RunnableWithContext.run(ThreadUtils.java:210)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.knime.core.util.ThreadPool$MyFuture.run(ThreadPool.java:123)
	at org.knime.core.util.ThreadPool$Worker.run(ThreadPool.java:246)
Caused by: org.knime.python2.kernel.PythonIOException: Blas GEMM launch failed : a.shape=(10000, 128), b.shape=(128, 10), m=10000, n=10, k=128
	 [[Node: dense_2/MatMul = MatMul[T=DT_FLOAT, _class=["loc:@training/Adadelta/gradients/dropout_2/cond/Merge_grad/cond_grad"], transpose_a=false, transpose_b=false, _device="/job:localhost/replica:0/task:0/device:GPU:0"](dropout_2/cond/Merge, dense_2/kernel/read)]]
	 [[Node: metrics/acc/Mean_1/_125 = _Recv[client_terminated=false, recv_device="/job:localhost/replica:0/task:0/device:CPU:0", send_device="/job:localhost/replica:0/task:0/device:GPU:0", send_device_incarnation=1, tensor_name="edge_899_metrics/acc/Mean_1", tensor_type=DT_FLOAT, _device="/job:localhost/replica:0/task:0/device:CPU:0"]()]]

Caused by op 'dense_2/MatMul', defined at:
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\PythonKernelLauncher.py", line 122, in <module>
    kernel.start()
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\python3\PythonKernel.py", line 88, in start
    self.execute_thread_executor.start()
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\python3\_QueuedExecutor.py", line 87, in start
    work_item.run()
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\concurrent\futures\thread.py", line 55, in run
    result = self.fn(*self.args, **self.kwargs)
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\python3\_QueuedExecutor.py", line 108, in _monitored_fn
    return fn(*args, **kwargs)
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\messaging\Task.py", line 179, in run
    self._runnable()
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\messaging\Task.py", line 143, in _run_internal
    received, self._message_handlers, self._message_id_supplier, self._set_result, self._workspace)
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\messaging\AbstractTaskHandler.py", line 76, in handle
    if self._handle_custom_message(message, message_id_supplier, message_to_send, result_consumer, workspace):
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\messaging\RequestHandlers.py", line 96, in _handle_custom_message
    response = self._respond(message, response_message_id, workspace)
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\messaging\RequestHandlers.py", line 376, in _respond
    output, error = workspace.execute(source_code, request.id)
  File "C:\Program Files\KNIME\plugins\org.knime.python2_4.3.3.v202105242123\py\PythonKernelBase.py", line 289, in execute
    exec(source_code, self._exec_env, self._exec_env)
  File "<string>", line 3, in <module>
  File "C:\Program Files\KNIME\plugins\org.knime.dl.keras_4.3.0.v202012011122\py\DLTF2NetworkReader.py", line 126, in read
    return read_keras(self.backend, path, compile, compatibility_mode)
  File "C:\Program Files\KNIME\plugins\org.knime.dl.keras_4.3.0.v202012011122\py\DLTF2NetworkReader.py", line 92, in read_keras
    }[backend](path, compile, compatibility_mode)
  File "C:\Program Files\KNIME\plugins\org.knime.dl.keras_4.3.0.v202012011122\py\DLTF2NetworkReader.py", line 98, in read_keras_tensorflow
    compatibility_mode=compatibility_mode)
  File "C:\Program Files\KNIME\plugins\org.knime.dl.keras_4.3.0.v202012011122\py\DLKerasTensorFlowNetwork.py", line 60, in read
    model = self._read_internal(path, compile)
  File "C:\Program Files\KNIME\plugins\org.knime.dl.keras_4.3.0.v202012011122\py\DLKerasNetwork.py", line 100, in _read_internal
    return load_model(path, compile=compile)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\models.py", line 270, in load_model
    model = model_from_config(model_config, custom_objects=custom_objects)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\models.py", line 347, in model_from_config
    return layer_module.deserialize(config, custom_objects=custom_objects)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\layers\__init__.py", line 55, in deserialize
    printable_module_name='layer')
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\utils\generic_utils.py", line 144, in deserialize_keras_object
    list(custom_objects.items())))
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\engine\topology.py", line 2535, in from_config
    process_node(layer, node_data)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\engine\topology.py", line 2492, in process_node
    layer(input_tensors[0], **kwargs)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\engine\topology.py", line 619, in __call__
    output = self.call(inputs, **kwargs)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\layers\core.py", line 877, in call
    output = K.dot(inputs, self.kernel)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\keras\backend\tensorflow_backend.py", line 1076, in dot
    out = tf.matmul(x, y)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\tensorflow\python\ops\math_ops.py", line 2018, in matmul
    a, b, transpose_a=transpose_a, transpose_b=transpose_b, name=name)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\tensorflow\python\ops\gen_math_ops.py", line 4456, in mat_mul
    name=name)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\tensorflow\python\framework\op_def_library.py", line 787, in _apply_op_helper
    op_def=op_def)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\tensorflow\python\util\deprecation.py", line 454, in new_func
    return func(*args, **kwargs)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\tensorflow\python\framework\ops.py", line 3155, in create_op
    op_def=op_def)
  File "C:\Users\Faheem\anaconda3\envs\py_3 env_1\lib\site-packages\tensorflow\python\framework\ops.py", line 1717, in __init__
    self._traceback = tf_stack.extract_stack()

InternalError (see above for traceback): Blas GEMM launch failed : a.shape=(10000, 128), b.shape=(128, 10), m=10000, n=10, k=128
	 [[Node: dense_2/MatMul = MatMul[T=DT_FLOAT, _class=["loc:@training/Adadelta/gradients/dropout_2/cond/Merge_grad/cond_grad"], transpose_a=false, transpose_b=false, _device="/job:localhost/replica:0/task:0/device:GPU:0"](dropout_2/cond/Merge, dense_2/kernel/read)]]
	 [[Node: metrics/acc/Mean_1/_125 = _Recv[client_terminated=false, recv_device="/job:localhost/replica:0/task:0/device:CPU:0", send_device="/job:localhost/replica:0/task:0/device:GPU:0", send_device_incarnation=1, tensor_name="edge_899_metrics/acc/Mean_1", tensor_type=DT_FLOAT, _device="/job:localhost/replica:0/task:0/device:CPU:0"]()]]

	at org.knime.python2.kernel.messaging.AbstractTaskHandler.handleFailureMessage(AbstractTaskHandler.java:146)
	at org.knime.python2.kernel.messaging.AbstractTaskHandler.handle(AbstractTaskHandler.java:92)
	at org.knime.dl.python.core.DLPythonAbstractCommands$DLTrainingTask.runInternal(DLPythonAbstractCommands.java:908)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)