上次已將ffmpeg的動(dòng)態(tài)庫(kù)編譯出來(lái)了，并且使用了ffmpeg的轉(zhuǎn)碼功能，成功將mp4格式視頻轉(zhuǎn)化為yuv視頻，這篇文章基于上次測(cè)試的demo，使用surfaceview顯示解碼完成的像素?cái)?shù)據(jù)

布局設(shè)置和權(quán)限添加

布局

<FrameLayout xmlns:android="http://schemas.android.com/apk/res/android"xmlns:tools="http://schemas.android.com/tools"android:layout_width="match_parent"android:layout_height="match_parent" ><com.cj5785.ffmpegnativeplayer.view.MySurfaceViewandroid:id="@+id/surface_view"android:layout_width="fill_parent"android:layout_height="fill_parent"/><Buttonandroid:layout_width="wrap_content"android:layout_height="wrap_content"android:text="開(kāi)始"android:onClick="mPlay" /></FrameLayout>

權(quán)限

<uses-permission android:name="android.permission.READ_EXTERNAL_STORAGE" /> <uses-permission android:name="android.permission.WRITE_EXTERNAL_STORAGE" /> <uses-permission android:name="android.permission.MOUNT_UNMOUNT_FILESYSTEMS" />

編寫自定義view和控制器

自定義View

package com.cj5785.ffmpegnativeplayer.view;import android.content.Context; import android.graphics.PixelFormat; import android.util.AttributeSet; import android.view.SurfaceHolder; import android.view.SurfaceView;public class MySurfaceView extends SurfaceView {public MySurfaceView(Context context) {super(context);init();}public MySurfaceView(Context context, AttributeSet attrs) {super(context, attrs);init();}public MySurfaceView(Context context, AttributeSet attrs, int defStyle) {super(context, attrs, defStyle);init();}//初始化像素格式private void init() {SurfaceHolder holder = getHolder();holder.setFormat(PixelFormat.RGBA_8888);} }

控制器

package com.cj5785.ffmpegnativeplayer;import android.view.Surface;public class NativePlayer {public native void render(String input, Surface surface);static {System.loadLibrary("avutil-54");System.loadLibrary("swresample-1");System.loadLibrary("avcodec-56");System.loadLibrary("avformat-56");System.loadLibrary("swscale-3");System.loadLibrary("postproc-53");System.loadLibrary("avfilter-5");System.loadLibrary("avdevice-56");System.loadLibrary("ffmpeg_native_player");}}

實(shí)現(xiàn)控制器native方法

• 使用javah生成頭文件，這里可能存在無(wú)法找到Surface簽名的問(wèn)題，這時(shí)候需要指定classpath路徑
  javah -classpath E:\eclipse-adt\sdk\platforms\android-15\android.jar;. com.cj5785.ffmpegnativeplayer.NativePlayer
  格式說(shuō)明：-classpath后面跟的是android.jar路徑，最后接native方法類的全名

• 新建jni文件夾，將頭文件移至jni文件夾，添加本地依賴

• 復(fù)制生成ffmpeg的include目錄和so動(dòng)態(tài)庫(kù)到j(luò)ni目錄

• 將之前的Android.mk和Application.mk復(fù)制到j(luò)ni文件夾，并做適當(dāng)修改
  Android.mk主要修改模塊名，使其與控制器調(diào)用相統(tǒng)一
  Application.mk主要將APP_PLATFORM := android-8修改為APP_PLATFORM := android-9
  注意，此處如果不修改Application.mk將導(dǎo)致android/native_window_jni.h無(wú)法找到，同時(shí)，由于使用了這個(gè)頭文件，需要在Android.mk配置-landroid

• 使用開(kāi)源庫(kù)libyuv實(shí)現(xiàn)yuv轉(zhuǎn)化為RGBA_8888
  下載開(kāi)源庫(kù)libyuv，下載地址libyuv下載地址
  將libyuv下的所有文件放入jni目錄(NDK工程規(guī)范，必須存在jni目錄)
  修改libyuv的Android.mk文件，將最后的include $(BUILD_STATIC_LIBRARY)改為include $(BUILD_SHARED_LIBRARY)，這樣就可以生成so動(dòng)態(tài)庫(kù)了
  還可以將LOCAL_MODULE := libyuv_static改為L(zhǎng)OCAL_MODULE := libyuv，方便so管理
  在jni目錄下執(zhí)行ndk-build即可對(duì)libyuv進(jìn)行編譯
  編譯生成的so動(dòng)態(tài)庫(kù)位于與jni目錄同級(jí)的lib下
  將lib添加到工程jni目錄下，為了便于管理，將jni的include目錄進(jìn)行重新分配，重新分配目錄如下：(已將libyuv的include加入到工程，這里沒(méi)有列出目錄下包含的頭文件)

│ Android.mk │ Application.mk │ com_cj5785_ffmpegnativeplayer_NativePlayer.h │ ffmpeg_native_player.c │ └─include├─ffmpeg│ │ libavcodec-56.so│ │ libavdevice-56.so│ │ libavfilter-5.so│ │ libavformat-56.so│ │ libavutil-54.so│ │ libpostproc-53.so│ │ libswresample-1.so│ │ libswscale-3.so│ │ │ ├─libavcodec│ ├─libavdevice│ ├─libavfilter│ ├─libavformat│ ├─libavutil│ ├─libpostproc│ ├─libswresample│ └─libswscale│ └─libyuv│ libyuv.h│ libyuv.so│ └─libyuv

• 修改Android.mk，使其能找到so動(dòng)態(tài)庫(kù)

LOCAL_PATH := $(call my-dir)include $(CLEAR_VARS) LOCAL_MODULE := avcodec LOCAL_SRC_FILES := include/ffmpeg/libavcodec-56.so include $(PREBUILT_SHARED_LIBRARY)include $(CLEAR_VARS) LOCAL_MODULE := avdevice LOCAL_SRC_FILES := include/ffmpeg/libavdevice-56.so include $(PREBUILT_SHARED_LIBRARY)include $(CLEAR_VARS) LOCAL_MODULE := avfilter LOCAL_SRC_FILES := include/ffmpeg/libavfilter-5.so include $(PREBUILT_SHARED_LIBRARY)include $(CLEAR_VARS) LOCAL_MODULE := avformat LOCAL_SRC_FILES := include/ffmpeg/libavformat-56.so include $(PREBUILT_SHARED_LIBRARY)include $(CLEAR_VARS) LOCAL_MODULE := avutil LOCAL_SRC_FILES := include/ffmpeg/libavutil-54.so include $(PREBUILT_SHARED_LIBRARY)include $(CLEAR_VARS) LOCAL_MODULE := postproc LOCAL_SRC_FILES := include/ffmpeg/libpostproc-53.so include $(PREBUILT_SHARED_LIBRARY)include $(CLEAR_VARS) LOCAL_MODULE := swresample LOCAL_SRC_FILES := include/ffmpeg/libswresample-1.so include $(PREBUILT_SHARED_LIBRARY)include $(CLEAR_VARS) LOCAL_MODULE := swscale LOCAL_SRC_FILES := include/ffmpeg/libswscale-3.so include $(PREBUILT_SHARED_LIBRARY)include $(CLEAR_VARS) LOCAL_MODULE := yuv LOCAL_SRC_FILES := include/libyuv/libyuv.so include $(PREBUILT_SHARED_LIBRARY)include $(CLEAR_VARS) LOCAL_MODULE := ffmpeg_native_player LOCAL_SRC_FILES := ffmpeg_native_player.c LOCAL_C_INCLUDES += $(LOCAL_PATH)/include/ffmpeg LOCAL_C_INCLUDES += $(LOCAL_PATH)/include/libyuv LOCAL_LDLIBS := -llog -landroid LOCAL_SHARED_LIBRARIES := avcodec avdevice avfilter avformat avutil postproc swresample swscale yuv include $(BUILD_SHARED_LIBRARY)

• 修改Application.mk，更改APP_PLATFORM，使其可以使用android/native_window_jni.h和android/native_window.h頭文件

APP_ABI := armeabi armeabi-v7a APP_PLATFORM := android-9

• 實(shí)現(xiàn)jni頭文件聲明的函數(shù)

#include <android/log.h> #include <stdio.h> #include <stdlib.h> #include <unistd.h> #include <android/native_window.h> #include <android/native_window_jni.h>#include "com_cj5785_ffmpegnativeplayer_NativePlayer.h"//封裝格式 #include "include/ffmpeg/libavformat/avformat.h" //解碼 #include "include/ffmpeg/libavcodec/avcodec.h" //像素處理 #include "include/ffmpeg/libswscale/swscale.h" //包含yuvlib頭文件 #include "include/libyuv/libyuv.h"#define LOGI(FORMAT,...) __android_log_print(4,"cj5785",FORMAT,##__VA_ARGS__); #define LOGE(FORMAT,...) __android_log_print(6,"cj5785",FORMAT,##__VA_ARGS__);JNIEXPORT void JNICALL Java_com_cj5785_ffmpegnativeplayer_NativePlayer_render(JNIEnv *env, jobject jobj, jstring jstr_path, jobject obj_surface) {LOGE("%s", "開(kāi)始");const char *input_cstr = (*env)->GetStringUTFChars(env, jstr_path, NULL);//1.注冊(cè)組件av_register_all();AVFormatContext *pFormatCtx = avformat_alloc_context();//2.打開(kāi)視頻文件if(avformat_open_input(&pFormatCtx, input_cstr, NULL, NULL) != 0){LOGE("%s", "打開(kāi)文件失敗!");return;}//3.獲取視頻相關(guān)信息if(avformat_find_stream_info(pFormatCtx, NULL) < 0){LOGE("%s", "獲取視頻信息失敗!");return;}int i = 0;int video_stream_index = -1;for (i = 0; i < pFormatCtx->nb_streams; i++) {if(pFormatCtx->streams[i]->codec->codec_type == AVMEDIA_TYPE_VIDEO){video_stream_index = i;break;}}if (video_stream_index == -1){LOGE("%s","找不到視頻流\n");return;}//4.獲取解碼器AVCodecContext *pCodecCtx = pFormatCtx->streams[video_stream_index]->codec;AVCodec *pCodec = avcodec_find_decoder(pCodecCtx->codec_id);if(pCodec == NULL){LOGE("%s", "無(wú)法解碼!");return;}//5.打開(kāi)解碼器if(avcodec_open2(pCodecCtx, pCodec, NULL) < 0){LOGE("%s", "解碼失敗!");return;}//6.以幀為單位讀取視頻文件AVPacket *packet = (AVPacket *)av_malloc(sizeof(AVPacket));AVFrame *pFrame = av_frame_alloc();AVFrame *pRGBFrame = av_frame_alloc();//native繪制//窗體設(shè)置ANativeWindow *nativeWindow = ANativeWindow_fromSurface(env, obj_surface);//緩沖區(qū)設(shè)置ANativeWindow_Buffer outBuffer;int len, got_frame, frame_count = 0;while(av_read_frame(pFormatCtx, packet) >= 0){if(packet->stream_index == video_stream_index){len = avcodec_decode_video2(pCodecCtx, pFrame, &got_frame, packet);if(len < 0){LOGE("%s","解碼錯(cuò)誤!");return;}if(got_frame){LOGI("解碼第%d幀", frame_count++);//a.lock//設(shè)置緩沖區(qū)屬性（寬，高，像素格式）ANativeWindow_setBuffersGeometry(nativeWindow, pCodecCtx->width, pCodecCtx->height, WINDOW_FORMAT_RGBA_8888);ANativeWindow_lock(nativeWindow, &outBuffer, NULL);//b.fix buffer//設(shè)置RGB的緩沖區(qū)以及屬性（像素格式，寬高），RGB緩沖區(qū)和outBuffer.bits是同一塊內(nèi)存avpicture_fill((AVPicture *)pRGBFrame, outBuffer.bits, AV_PIX_FMT_RGBA, pCodecCtx->width, pCodecCtx->height);//YUV轉(zhuǎn)化為RGBI420ToARGB(pFrame->data[0], pFrame->linesize[0],pFrame->data[2], pFrame->linesize[2],pFrame->data[1], pFrame->linesize[1],pRGBFrame->data[0], pRGBFrame->linesize[0],pCodecCtx->width, pCodecCtx->height);//c.unlockANativeWindow_unlockAndPost(nativeWindow);usleep(16 * 1000);}}av_free_packet(packet);}ANativeWindow_release(nativeWindow);av_frame_free(&pFrame);av_frame_free(&pRGBFrame);avcodec_close(pCodecCtx);avformat_free_context(pFormatCtx);(*env)->ReleaseStringUTFChars(env, jstr_path, input_cstr); }

調(diào)用native，使其能夠播放

package com.cj5785.ffmpegnativeplayer;import java.io.File;import com.cj5785.ffmpegnativeplayer.view.MySurfaceView;import android.app.Activity; import android.os.Bundle; import android.os.Environment; import android.view.Surface; import android.view.View;public class MainActivity extends Activity {private NativePlayer player;private MySurfaceView mySurfaceView;@Overrideprotected void onCreate(Bundle savedInstanceState) {super.onCreate(savedInstanceState);setContentView(R.layout.activity_main);mySurfaceView = (MySurfaceView) findViewById(R.id.surface_view);player = new NativePlayer();}public void mPlay(View view) {String input = Environment.getExternalStorageDirectory().getAbsolutePath() + File.separatorChar + "oneplus.mp4";Surface surface = mySurfaceView.getHolder().getSurface();player.render(input, surface);} }

至此，已經(jīng)可以編譯生成apk了，在手機(jī)上測(cè)試也沒(méi)有問(wèn)題

更改布局和主活動(dòng)，使其可以播放多個(gè)測(cè)試視頻

MainActivity.java

package com.cj5785.ffmpegnativeplayer;import java.io.File;import com.cj5785.ffmpegnativeplayer.view.MySurfaceView;import android.app.Activity; import android.os.Bundle; import android.os.Environment; import android.view.Surface; import android.view.View; import android.widget.ArrayAdapter; import android.widget.Spinner;public class MainActivity extends Activity {private NativePlayer player;private MySurfaceView mySurfaceView;private Spinner sp_video;@Overrideprotected void onCreate(Bundle savedInstanceState) {super.onCreate(savedInstanceState);setContentView(R.layout.activity_main);mySurfaceView = (MySurfaceView) findViewById(R.id.surface_view);sp_video = (Spinner)findViewById(R.id.sp_video);player = new NativePlayer();//視頻列表String[] videoArray = getResources().getStringArray(R.array.video_list);ArrayAdapter<String> adapter = new ArrayAdapter<String>(this, android.R.layout.simple_list_item_1, android.R.id.text1,videoArray);sp_video.setAdapter(adapter);}public void mPlay(View view) {String filename = sp_video.getSelectedItem().toString();String input = Environment.getExternalStorageDirectory().getAbsolutePath() + File.separatorChar + filename;Surface surface = mySurfaceView.getHolder().getSurface();player.render(input, surface);} }

activity_main.xml

<FrameLayout xmlns:android="http://schemas.android.com/apk/res/android"xmlns:tools="http://schemas.android.com/tools"android:layout_width="match_parent"android:layout_height="match_parent" ><com.cj5785.ffmpegnativeplayer.view.MySurfaceViewandroid:id="@+id/surface_view"android:layout_width="fill_parent"android:layout_height="fill_parent"/><LinearLayoutandroid:layout_width="wrap_content"android:layout_height="wrap_content"android:orientation="horizontal"><Spinner android:id="@+id/sp_video"android:layout_width="wrap_content"android:layout_height="wrap_content"/><Buttonandroid:layout_width="wrap_content"android:layout_height="wrap_content"android:text="開(kāi)始"android:onClick="mPlay" /></LinearLayout></FrameLayout>

在string.xml中添加數(shù)組值

<string-array name="video_list"><item>naxienian.mp4</item><item>cuc_ieschool.mkv</item><item>sintel.wmv</item><item>Nocturne.m4a</item> </string-array>

需要注意的問(wèn)題

在native的實(shí)現(xiàn)過(guò)程中，I420ToARGB()方法在調(diào)用的時(shí)候，UV的位置是顛倒的，需要對(duì)調(diào)UV的位置
在這個(gè)示例程序中，旨在說(shuō)明native是怎么繪制的，其代碼存在嚴(yán)重不足，比如在主線程中繪制界面
部分視頻會(huì)出現(xiàn)花屏現(xiàn)象，這個(gè)問(wèn)題在后面多線程解碼的時(shí)候會(huì)解決

轉(zhuǎn)載于:https://www.cnblogs.com/cj5785/p/10664660.html

總結(jié)

以上是生活随笔為你收集整理的ffmpeg学习笔记-native原生绘制的全部?jī)?nèi)容，希望文章能夠幫你解決所遇到的問(wèn)題。

如果覺(jué)得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。