In a mixing bowl, add the mashed sweet potatoes, light brown sugar, sweetened condensed milk, softened salted butter, eggs, French Vanilla Pudding mix, vanilla extract, cinnamon, and nutmeg, mixing in between each ingredient added. Pour the prepared filling into a pie crust. Bake the pie at 350 degrees Fahrenheit for 45 to 55 minutes, or until a toothpick inserted into the center comes out clean. Once baked, let it cool and then chill in the fridge before serving. You can top it with marshmallow meringue or whipped cream.