First, use this tool to extract the CombinedStreaming_SFX.pck (or the other one, if you're looking for weapon and dialog files) in the audio directory of the Bioshock Infinite folder.

Next, use ww2ogg to make the output into ogg files. Run this in command line with the ww2ogg.exe in the same folder as the output from the first part:

    for %f in (*.wav) do ww2ogg.exe %f --pcb packed_codebooks_aoTuV_603.bin


Finally, use Revorb (direct download link to make the ogg files usable:

    for /r %f in (*.ogg) do revorb.exe "%f"