U okviru Seminara za teorijsko računarstvo, u ponedjeljak 20. ožujka 2023. u 15 sati,

Davor Runje (airt, Zagreb) održat će predavanje pod naslovom:

"Constrained Monotonic Neural Networks".

Sažetak: Deep neural networks are becoming increasingly popular in approximating arbitrary functions from noisy data. But wider adoption is being hindered by the need to explain such models and to impose additional constraints on them. Monotonicity constraint is one of the most requested properties in real-world scenarios and is the focus of this paper. One of the oldest ways to construct a monotonic fully connected neural network is to constrain its weights to be non-negative while employing a monotonic activation function. Unfortunately, this construction does not work with popular non-saturated activation functions such as ReLU, ELU, SELU etc, as it can only approximate convex functions. We show this shortcoming can be fixed by employing the original activation function for a part of the neurons in the layer and employing its point reflection for the other part. Our experiments show this approach of building monotonic deep neural networks has matching or better accuracy when compared to other state-of-the-art methods such as deep lattice networks or monotonic networks obtained by heuristic regularization. This method is the simplest one in the sense of having the least number of parameters and does not require any modifications to the learning procedure or steps post-learning steps.

Predavanje će se održati UŽIVO u zgradi PMF-Matematičkog odsjeka, dvorana 104.

Pozivaju se članovi seminara, studenti diplomskih studija, kao i ostali zainteresirani da se pridruže.

Robert Manger.