hjnormey/siloqy
Public Access
1
0
Fork 0
Code Issues 7 Pull Requests 1 Actions Packages Projects Releases Wiki Activity

SILOQY RNG needs "conditioning": Variance, etc.- #2

New Issue
Open
opened 2025-10-08 12:28:39 +02:00 by hjnormey · 3 comments
hjnormey commented 2025-10-08 12:28:39 +02:00
Owner
Copy Link

The implemented RNG (2) is "too perfect": Variance is low. It is "better-than-NIST".-
THIS is BAD for certain ML functions: Weight init needs simmetry breakage to actually train.-
SO a "conditioner" or variance-injector or similar needs developed.-

The implemented RNG (2) is "too perfect": Variance is low. It is "better-than-NIST".- THIS is BAD for certain ML functions: Weight init needs simmetry breakage to actually train.- SO a "conditioner" or variance-injector or similar needs developed.-
Claude-Fixing Gaussian random number generation (FULL) (1)_OCR_INFUSED_TEXT.md
270 KiB
hjnormey commented 2025-10-08 16:20:29 +02:00
Author
Owner
Copy Link

Prototype at:

PS: Might be applicable into/to "ML-based weight init" via "meta" network (v. ChatGPT): That system ML-d the best init weights based on a "suite" of stat-tests on incoming data, training a "meta" network.-
.. that then provided a better startinf off point for downstream ML.-

Prototype at: - https://claude.ai/chat/533f6f3d-036b-4646-be0c-fdcce91b082d PS: Might be applicable into/to "ML-based weight init" via "meta" network (v. ChatGPT): That system ML-d the best init weights based on a "suite" of stat-tests on incoming data, training a "meta" network.- .. that then provided a better startinf off point for downstream ML.-
hjnormey commented 2025-10-09 17:42:20 +02:00
Author
Owner
Copy Link

https://chatgpt.com/g/g-p-68bf350bb9748191ad9debe95867c538-siloqy-dolphin/c/68e679cb-4ee8-832b-a814-23015788521b

https://chatgpt.com/g/g-p-68bf350bb9748191ad9debe95867c538-siloqy-dolphin/c/68e679cb-4ee8-832b-a814-23015788521b
hjnormey commented 2025-10-10 10:57:09 +02:00
Author
Owner
Copy Link

More code:

More code: - https://grok.com/c/3ffde5db-8e2b-40bd-b018-094c922822d5
Sign in to join this conversation.
main
Branches Tags
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
hjnormey
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: hjnormey/siloqy#2
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?