Skip to content

Update runtests.jl in OptimizationOptimisers #872

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Jan 16, 2025
Merged

Update runtests.jl in OptimizationOptimisers #872

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
0b43c2b
Update runtests.jl in OptimizationOptimisers
Vaibhavdixit02 Jan 16, 2025
4792dc9
Update lib/OptimizationOptimisers/test/runtests.jl
Vaibhavdixit02 Jan 16, 2025
6c75ddd
Update runtests.jl
Vaibhavdixit02 Jan 16, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 2 additions & 6 deletions lib/OptimizationOptimisers/test/runtests.jl
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
using OptimizationOptimisers, ForwardDiff, Optimization
using Test
using Zygote
using Lux, MLUtils, Random, ComponentArrays, Printf, MLDataDevices

@testset "OptimizationOptimisers.jl" begin
rosenbrock(x, p) = (p[1] - x[1])^2 + p[2] * (x[2] - x[1]^2)^2
Expand Down Expand Up @@ -73,9 +74,6 @@ using Zygote
end

@testset "Minibatching" begin
using Optimization, OptimizationOptimisers, Lux, Zygote, MLUtils, Random,
ComponentArrays

x = rand(Float32, 10000)
y = sin.(x)
data = MLUtils.DataLoader((x, y), batchsize = 100)
Expand All @@ -87,7 +85,7 @@ end
smodel = StatefulLuxLayer{true}(model, nothing, st)

function callback(state, l)
state.iter % 25 == 1 && @show "Iteration: %5d, Loss: %.6e\n" state.iter l
state.iter % 25 == 1 && Printf.@printf "Iteration: %5d, Loss: %.6e\n" state.iter l
return l < 1e-4
end

Expand All @@ -101,7 +99,6 @@ end

res = Optimization.solve(prob, Optimisers.Adam(), epochs = 50)

@test res.objective < 1e-4
@test res.stats.iterations == 50*length(data)
@test res.stats.fevals == 50*length(data)
@test res.stats.gevals == 50*length(data)
Expand All @@ -110,7 +107,6 @@ end

@test res.objective < 1e-4

using MLDataDevices
data = CPUDevice()(data)
optf = OptimizationFunction(loss, AutoZygote())
prob = OptimizationProblem(optf, ps_ca, data)
Expand Down
Loading