java - java.lang.IllegalStateException:无法将轨道添加到多路复用器

我正在尝试合并音频和视频，但是我正在获取java.lang.IllegalStateException: Failed to add the track to the muxer。我认为问题是我无法将.weba音频添加到多路复用器。如果是这种情况，我该如何合并它们？

fun mux() {
    var outputFile = ""
    val dir = Environment.getExternalStoragePublicDirectory(Environment.DIRECTORY_DOWNLOADS).absolutePath
    val file = File("$dir${File.separator}final.mp4")
    file.createNewFile()
    outputFile = file.absolutePath


    val videoExtractor = MediaExtractor()
    videoExtractor.setDataSource("$dir${File.separator}output.mp4")
    videoExtractor.selectTrack(0)
    val videoFormat = videoExtractor.getTrackFormat(0)
    val videoMimeType = videoFormat.getString(MediaFormat.KEY_MIME)
    val videoFrameMaxInputSize = videoFormat.getInteger(MediaFormat.KEY_MAX_INPUT_SIZE)
    val videoFrameRate = videoFormat.getInteger(MediaFormat.KEY_FRAME_RATE)
    val videoDuration = videoFormat.getLong(MediaFormat.KEY_DURATION)

    val audioExtractor = MediaExtractor()
    audioExtractor.setDataSource("$dir${File.separator}output.mp3")
    audioExtractor.selectTrack(0)
    val audioFormat = audioExtractor.getTrackFormat(0)
    val audioMimeType = audioFormat.getString(MediaFormat.KEY_MIME)

    // start muxer
    val mediaMuxer = MediaMuxer(outputFile, MediaMuxer.OutputFormat.MUXER_OUTPUT_MPEG_4)
    val videoTrackIndex = mediaMuxer.addTrack(videoFormat)
    val audioTrackIndex = mediaMuxer.addTrack(audioFormat)
    val byteBuffer = ByteBuffer.allocate(videoFrameMaxInputSize)
    mediaMuxer.start()

    // writing video
    val videoBufferInfo = MediaCodec.BufferInfo()
    videoExtractor.selectTrack(videoTrackIndex)

    while (true) {
        val readVideoSampleSize = videoExtractor.readSampleData(byteBuffer, 0)
        if (readVideoSampleSize < 0) {
            videoExtractor.unselectTrack(videoTrackIndex)
            break
        }
        val videoSampleTime = videoExtractor.sampleTime
        videoBufferInfo.size = readVideoSampleSize
        videoBufferInfo.presentationTimeUs = videoSampleTime
        //videoBufferInfo.presentationTimeUs += 1000 * 1000 / frameRate;
        videoBufferInfo.offset = 0
        videoBufferInfo.flags = videoExtractor.sampleFlags
        mediaMuxer.writeSampleData(videoTrackIndex, byteBuffer, videoBufferInfo)
        videoExtractor.advance()

        Log.d("hello", readVideoSampleSize.toString())
    }

    // writing audio
    val audioBufferInfo = MediaCodec.BufferInfo()
    audioExtractor.selectTrack(audioTrackIndex)

    while (true) {
        val readAudioSampleSize = audioExtractor.readSampleData(byteBuffer, 0)
        if (readAudioSampleSize < 0) {
            break
        }
        val audioSampleTime = audioExtractor.sampleTime
        audioBufferInfo.size = readAudioSampleSize
        audioBufferInfo.presentationTimeUs = audioSampleTime
        if (audioBufferInfo.presentationTimeUs > videoDuration) {
            audioExtractor.unselectTrack(audioTrackIndex)
            break
        }
        audioBufferInfo.offset = 0
        audioBufferInfo.flags = audioExtractor.sampleFlags
        mediaMuxer.writeSampleData(audioTrackIndex, byteBuffer, audioBufferInfo)
        audioExtractor.advance()
    }


    // releasing resources
    try {
        mediaMuxer.stop()
        mediaMuxer.release()
    } catch (e: Exception) {
        e.printStackTrace()
    }

    try {
        videoExtractor.release()
    } catch (e: Exception) {
        e.printStackTrace()
    }

    try {
        audioExtractor.release()
    } catch (e: Exception) {
        e.printStackTrace()
    }
}

编辑

我也尝试了.mp3音频，但这给了我同样的错误。

最佳答案

简单的答案是，您不能将它们直接与MediaMuxer API合并。该类的文档带有一个table，带有所有受支持的格式。对于mpeg4输出，支持的音频编解码器为AAC，AMR_NB和AMR_WB。

您可以尝试使用 MediaCodec 类之类的工具解码音频数据，然后将其编码为支持的格式之一。如果您只想使用Android API。否则，那里有很多库可以使用多种编解码器进行多路复用。