engine: D4R_M_DUMP also writes the M / L network's activations layer by layer
d4r-m's D4R_M_DUMP wrote the network's input (tokens) and output (head); it now also writes skip1, merged1, skip2, merged2, tubeA, tubeB and dec2, so that a difference between two builds can be found at the first layer it appears. Signed-off-by: itchyfeetleech <[email protected]>
This commit is contained in:
1 parent
0ba235a05b
commit
b7b559ff6a
1 file changed
+8
@@ -528,6 +528,14 @@ std::vector<MEngine::DebugResource> MEngine::debugResources() const {
|
||||
std::vector<DebugResource> r{{"enc0-params", e.enc0P.handle, VK_NULL_HANDLE, e.enc0P.size, 0, 0},
|
||||
{"tokens", e.tokens.handle, VK_NULL_HANDLE, e.tokens.size, 0, 0},
|
||||
{"head", e.dec1Out.handle, VK_NULL_HANDLE, e.dec1Out.size, 0, 0},
|
||||
// the network's own activations, layer by layer
|
||||
{"skip1", e.skip1.handle, VK_NULL_HANDLE, e.skip1.size, 0, 0},
|
||||
{"merged1", e.merged1.handle, VK_NULL_HANDLE, e.merged1.size, 0, 0},
|
||||
{"skip2", e.skip2.handle, VK_NULL_HANDLE, e.skip2.size, 0, 0},
|
||||
{"merged2", e.merged2.handle, VK_NULL_HANDLE, e.merged2.size, 0, 0},
|
||||
{"tubeA", e.tubeA.handle, VK_NULL_HANDLE, e.tubeA.size, 0, 0},
|
||||
{"tubeB", e.tubeB.handle, VK_NULL_HANDLE, e.tubeB.size, 0, 0},
|
||||
{"dec2", e.dec2Out.handle, VK_NULL_HANDLE, e.dec2Out.size, 0, 0},
|
||||
{"gates", VK_NULL_HANDLE, e.gates.handle, VkDeviceSize(w) * h * 4, w, h},
|
||||
{"mix", VK_NULL_HANDLE, e.mix.handle, VkDeviceSize(w) * h * 4, w, h},
|
||||
{"cov", VK_NULL_HANDLE, e.cov.handle, VkDeviceSize(w) * h * 8, w, h},
|
||||
|
||||
Reference in new issue
Block a user