//The function that i am trying to minimize, inputArr is constant while it is the weights that i want to optimize
FunctionToMinimize(weights, inputArr)
    totalCost = 0

    for input in inputArr
        //For each input (which is a vector) i let it propogate through an ANN which gives me an ouput (also vector)
        output = PropegateThroughANN(weights, input)

        //The total cost is calculated using the output. However this is blackboxed and i can not get, for example, the derivative
        totalCost += CostCalculatingFunction(output)

    return totalCost