SIAM Journal on Optimization · 2024 · 11 citations · 39 references
Natural SciencesMathematicsDerivativesDifferential EquationsOptimizationConvex AnalysisConvex OptimizationGradient-based OptimizationNonlinear ProgrammingOptimization TheoryAutomatic DifferentiationDifferentiationExistence Of MinimizersMinimization
We leverage path differentiability and a recent result on nonsmooth implicit\ndifferentiation calculus to give sufficient conditions ensuring that the\nsolution to a monotone inclusion problem will be path differentiable, with\nformulas for computing its generalized gradient. A direct consequence of our\nresult is that these solutions happen to be differentiable almost everywhere.\nOur approach is fully compatible with automatic differentiation and comes with\nassumptions which are easy to check, roughly speaking: semialgebraicity and\nstrong monotonicity. We illustrate the scope of our results by considering\nthree fundamental composite problem settings: strongly convex problems, dual\nsolutions to convex minimization problems and primal-dual solutions to min-max\nproblems.\n
39
Advances in neural information processing systems 7
Computers & Mathematics with Applications · 1996 · 14.4K citations
Training with Noise is Equivalent to Tikhonov Regularization
Chris Bishop · Neural Computation · 1995 · 1.3K citations