Place milk, sugar and butter in a heavy bottom sauce pan over medium to low heat and melt sugar while stirring, about 10 mins. Next bring to a boil then add finely grated ginger. Allow the fudge to simmer for about 15 minutes while stirring constantly.

Test the fudge to by dropping a small amount in a cup of cold water to see if it has reached soft boil stage. You can also use a candy thermometer and remove from heat at 240-250 degrees.

Remove from heat an let sit for about 3 minutes before mixing vigorously until the fudge has thickened, this should take about 10 minutes. You can also mix with a hand mixer.