1000字范文,内容丰富有趣,学习的好帮手!
1000字范文 > 讯飞SDK图文使用说明 语音听写 语音合成 声纹密码 人脸识别(适配Android7.0)

讯飞SDK图文使用说明 语音听写 语音合成 声纹密码 人脸识别(适配Android7.0)

时间:2023-06-25 04:45:27

相关推荐

讯飞SDK图文使用说明  语音听写 语音合成 声纹密码 人脸识别(适配Android7.0)

关于讯飞,他们关于语音做的AI功能SDK特别好,我经过使用有了深刻的体验,这次讲一讲语音听写、语音合成、声纹密码、人脸识别这三种的功能的体验。

1.首先到讯飞开放平台注册账号,然后到右上角点击我的应用创建应用,并给应用添加新功能

/

2.然后在我的应用界面点击对应应用的栏目的SDK下载按钮跳转页面,这里我可以看到语音听写、人脸识别、语音合成、声纹识别都是免费的,然后其他的几个有体验标识的功能,每天也也可以使用500。

3.我们点击SDK下载按钮就会下载一个压缩包,解压后我们把sample文件夹下speechDemo文件夹的代码都移植到Android Studio上,因为这些代码原本都是Android Studio上创建的,所以不用改什么。我这里是直接创建一个包名一样的project,然后把speechDemo文件夹的代码直接移植过去。移植完后,还需要将根目录的assets、libs、res文件直接复制过去,选择全部覆盖。

4.适配Android6.0权限申请

在MainActivity的onCreate函数里加入以下代码

if (Build.VERSION.SDK_INT >= Build.VERSION_CODES.M) {requestPermissions(new String[]{Manifest.permission.READ_PHONE_STATE, Manifest.permission.ACCESS_FINE_LOCATION, Manifest.permission.RECORD_AUDIO, Manifest.permission.READ_CONTACTS,Manifest.permission.WRITE_EXTERNAL_STORAGE, Manifest.permission.READ_EXTERNAL_STORAGE,Manifest.permission.ACCESS_COARSE_LOCATION, Manifest.permission.CAMERA}, 1001);}

5.适配Android7.0

首先在AndroidManifest里添加一个相机权限,因为有的手机调用系统相机需要这个权限

<uses-permission android:name="android.permission.CAMERA"/>

然后修改OnlineFaceDemo这个类,

public class OnlineFaceDemo extends Activity implements View.OnClickListener {private final String TAG = "OnlineFaceDemo";private final int REQUEST_PICTURE_CHOOSE = 1;private final int REQUEST_CAMERA_IMAGE = 2;private Bitmap mImage = null;private byte[] mImageData = null;// authid为6-18个字符长度,用于唯一标识用户private String mAuthid = null;private Toast mToast;// 进度对话框private ProgressDialog mProDialog;private EditText online_authid;// 拍照得到的照片文件private File mPictureFile;// FaceRequest对象,集成了人脸识别的各种功能//private FaceRequest mFaceRequest;//采用身份识别接口进行在线人脸识别private IdentityVerifier mIdVerifier;// 模型操作private int mModelCmd;// 删除模型private final static int MODEL_DEL = 1;private static final int CODE_GALLERY_REQUEST = 0xa0;private static final int CODE_CAMERA_REQUEST = 0xa1;private static final int CODE_RESULT_REQUEST = 0xa2;private static final int CAMERA_PERMISSIONS_REQUEST_CODE = 0x03;private static final int STORAGE_PERMISSIONS_REQUEST_CODE = 0x04;private File fileUri = new File(Environment.getExternalStorageDirectory().getPath() + "/photo.jpg");private File fileCropUri = new File(Environment.getExternalStorageDirectory().getPath() + "/crop_photo.jpg");private Uri imageUri;private Uri cropImageUri;@SuppressLint("ShowToast")@Overrideprotected void onCreate(Bundle savedInstanceState) {super.onCreate(savedInstanceState);this.requestWindowFeature(Window.FEATURE_NO_TITLE);setContentView(R.layout.online_facedemo);findViewById(R.id.online_pick).setOnClickListener(OnlineFaceDemo.this);findViewById(R.id.online_reg).setOnClickListener(OnlineFaceDemo.this);findViewById(R.id.online_verify).setOnClickListener(OnlineFaceDemo.this);findViewById(R.id.online_camera).setOnClickListener(OnlineFaceDemo.this);findViewById(R.id.btn_modle_delete).setOnClickListener(OnlineFaceDemo.this);findViewById(R.id.btn_identity).setOnClickListener(OnlineFaceDemo.this);online_authid = (EditText) findViewById(R.id.online_authid);mToast = Toast.makeText(this, "", Toast.LENGTH_SHORT);mProDialog = new ProgressDialog(this);mProDialog.setCancelable(true);mProDialog.setTitle("请稍后");mProDialog.setOnCancelListener(new DialogInterface.OnCancelListener() {@Overridepublic void onCancel(DialogInterface dialog) {// cancel进度框时,取消正在进行的操作if (null != mIdVerifier) {mIdVerifier.cancel();}}});mIdVerifier = IdentityVerifier.createVerifier(OnlineFaceDemo.this, new InitListener() {@Overridepublic void onInit(int errorCode) {if (ErrorCode.SUCCESS == errorCode) {showTip("引擎初始化成功");} else {showTip("引擎初始化失败,错误码:" + errorCode);}}});}private void register(JSONObject obj) throws JSONException {int ret = obj.getInt("ret");if (ret != 0) {showTip("注册失败");return;}if ("success".equals(obj.get("rst"))) {showTip("注册成功");} else {showTip("注册失败");}}private void verify(JSONObject obj) throws JSONException {int ret = obj.getInt("ret");if (ret != 0) {showTip("验证失败");return;}if ("success".equals(obj.get("rst"))) {if (obj.getBoolean("verf")) {showTip("通过验证,欢迎回来!");} else {showTip("验证不通过");}} else {showTip("验证失败");}}/*** 人脸注册监听器*/private IdentityListener mEnrollListener = new IdentityListener() {@Overridepublic void onResult(IdentityResult result, boolean islast) {Log.d(TAG, result.getResultString());if (null != mProDialog) {mProDialog.dismiss();}try {JSONObject object = new JSONObject(result.getResultString());int ret = object.getInt("ret");if (ErrorCode.SUCCESS == ret) {showTip("注册成功");}else {showTip(new SpeechError(ret).getPlainDescription(true));}} catch (JSONException e) {e.printStackTrace();}}@Overridepublic void onEvent(int eventType, int arg1, int arg2, Bundle obj) {}@Overridepublic void onError(SpeechError error) {if (null != mProDialog) {mProDialog.dismiss();}showTip(error.getPlainDescription(true));}};/*** 人脸验证监听器*/private IdentityListener mVerifyListener = new IdentityListener() {@Overridepublic void onResult(IdentityResult result, boolean islast) {Log.d(TAG, result.getResultString());if (null != mProDialog) {mProDialog.dismiss();}try {JSONObject object = new JSONObject(result.getResultString());Log.d(TAG,"object is: "+object.toString());String decision = object.getString("decision");if ("accepted".equalsIgnoreCase(decision)) {showTip("通过验证");} else {showTip("验证失败");}} catch (JSONException e) {e.printStackTrace();}}@Overridepublic void onEvent(int eventType, int arg1, int arg2, Bundle obj) {}@Overridepublic void onError(SpeechError error) {if (null != mProDialog) {mProDialog.dismiss();}showTip(error.getPlainDescription(true));}};/*** 人脸模型操作监听器*/private IdentityListener mModelListener = new IdentityListener() {@Overridepublic void onResult(IdentityResult result, boolean islast) {Log.d(TAG, result.getResultString());JSONObject jsonResult = null;int ret = ErrorCode.SUCCESS;try {jsonResult = new JSONObject(result.getResultString());ret = jsonResult.getInt("ret");} catch (JSONException e) {e.printStackTrace();}// 根据操作类型判断结果类型switch (mModelCmd) {case MODEL_DEL:if (ErrorCode.SUCCESS == ret) {online_authid.setEnabled(true);showTip("删除成功");} else {showTip("删除失败");}break;default:break;}}@Overridepublic void onEvent(int eventType, int arg1, int arg2, Bundle obj) {}@Overridepublic void onError(SpeechError error) {// 弹出错误信息showTip(error.getPlainDescription(true));}};private void executeModelCommand(String cmd) {// 设置人脸模型操作参数// 清空参数mIdVerifier.setParameter(SpeechConstant.PARAMS, null);// 设置会话场景mIdVerifier.setParameter(SpeechConstant.MFV_SCENES, "ifr");// 用户idmIdVerifier.setParameter(SpeechConstant.AUTH_ID, mAuthid);// 设置模型参数,若无可以传空字符传StringBuffer params = new StringBuffer();// 执行模型操作mIdVerifier.execute("ifr", cmd, params.toString(), mModelListener);}@Overridepublic void onClick(View view) {int ret = ErrorCode.SUCCESS;mAuthid = online_authid.getText().toString();if(TextUtils.isEmpty(mAuthid)) {showTip("请输入用户ID");return;}else {online_authid.setEnabled(false);}switch (view.getId()) {case R.id.online_pick:PhotoUtils.openPic(this, CODE_GALLERY_REQUEST);/*Intent intent = new Intent();intent.setType("image*//*");intent.setAction(Intent.ACTION_PICK);startActivityForResult(intent, REQUEST_PICTURE_CHOOSE);*/break;case R.id.online_reg:if (TextUtils.isEmpty(mAuthid)) {showTip("authid不能为空");return;}if (null != mImageData) {mProDialog.setMessage("注册中...");mProDialog.show();// 设置用户标识,格式为6-18个字符(由字母、数字、下划线组成,不得以数字开头,不能包含空格)。// 当不设置时,云端将使用用户设备的设备ID来标识终端用户。// 设置人脸注册参数// 清空参数mIdVerifier.setParameter(SpeechConstant.PARAMS, null);// 设置会话场景mIdVerifier.setParameter(SpeechConstant.MFV_SCENES, "ifr");// 设置会话类型mIdVerifier.setParameter(SpeechConstant.MFV_SST, "enroll");// 设置用户idmIdVerifier.setParameter(SpeechConstant.AUTH_ID, mAuthid);// 设置监听器,开始会话mIdVerifier.startWorking(mEnrollListener);// 子业务执行参数,若无可以传空字符传StringBuffer params = new StringBuffer();// 向子业务写入数据,人脸数据可以一次写入mIdVerifier.writeData("ifr", params.toString(), mImageData, 0, mImageData.length);// 停止写入mIdVerifier.stopWrite("ifr");} else {showTip("请选择图片后再注册");}break;case R.id.online_verify:mAuthid = ((EditText) findViewById(R.id.online_authid)).getText().toString();if (TextUtils.isEmpty(mAuthid)) {showTip("authid不能为空");return;}if (null != mImageData) {mProDialog.setMessage("验证中...");mProDialog.show();// 设置人脸验证参数// 清空参数mIdVerifier.setParameter(SpeechConstant.PARAMS, null);// 设置会话场景mIdVerifier.setParameter(SpeechConstant.MFV_SCENES, "ifr");// 设置会话类型mIdVerifier.setParameter(SpeechConstant.MFV_SST, "verify");// 设置验证模式,单一验证模式:sinmIdVerifier.setParameter(SpeechConstant.MFV_VCM, "sin");// 用户idmIdVerifier.setParameter(SpeechConstant.AUTH_ID, mAuthid);// 设置监听器,开始会话mIdVerifier.startWorking(mVerifyListener);// 子业务执行参数,若无可以传空字符传StringBuffer params = new StringBuffer();// 向子业务写入数据,人脸数据可以一次写入mIdVerifier.writeData("ifr", params.toString(), mImageData, 0, mImageData.length);// 停止写入mIdVerifier.stopWrite("ifr");} else {showTip("请选择图片后再验证");}break;case R.id.online_camera:// 设置相机拍照后照片保存路径imageUri = Uri.fromFile(fileUri);if (Build.VERSION.SDK_INT >= Build.VERSION_CODES.N)imageUri = FileProvider.getUriForFile(OnlineFaceDemo.this, "com.zz.fileprovider", fileUri);//通过FileProvider创建一个content类型的UriPhotoUtils.takePicture(this, imageUri, CODE_CAMERA_REQUEST);break;case R.id.btn_modle_delete:// 人脸模型删除mModelCmd = MODEL_DEL;executeModelCommand("delete");break;case R.id.btn_identity:Intent init = new Intent(OnlineFaceDemo.this, GroupManagerActivity.class);init.putExtra("auth_id",mAuthid);init.putExtra("mfv_scenes","ifr");startActivity(init);break;default:break;}//end of switchif( ErrorCode.SUCCESS != ret ){mProDialog.dismiss();showTip( "出现错误:"+ret );}}private static final int OUTPUT_X = 480;private static final int OUTPUT_Y = 480;@Overrideprotected void onActivityResult(int requestCode, int resultCode, Intent data) {if (resultCode != RESULT_OK) {return;}String fileSrc = null;if (requestCode == REQUEST_PICTURE_CHOOSE) {if ("file".equals(data.getData().getScheme())) {// 有些低版本机型返回的Uri模式为filefileSrc = data.getData().getPath();} else {// Uri模型为contentString[] proj = {MediaStore.Images.Media.DATA};Cursor cursor = getContentResolver().query(data.getData(), proj,null, null, null);cursor.moveToFirst();int idx = cursor.getColumnIndexOrThrow(MediaStore.Images.Media.DATA);fileSrc = cursor.getString(idx);cursor.close();}// 跳转到图片裁剪页面FaceUtil.cropPicture(this,Uri.fromFile(new File(fileSrc)));} else if (requestCode == REQUEST_CAMERA_IMAGE) {if (null == mPictureFile) {showTip("拍照失败,请重试");return;}/* fileSrc = mPictureFile.getAbsolutePath();updateGallery(fileSrc);*/// 跳转到图片裁剪页面// FaceUtil.cropPicture(this, FileProvider.getUriForFile(OnlineFaceDemo.this, "com.zz.fileprovider", new File(fileSrc)));cropImageUri = Uri.fromFile(fileCropUri);PhotoUtils.cropImageUri(this, imageUri, cropImageUri, 1, 1, OUTPUT_X, OUTPUT_Y, CODE_RESULT_REQUEST);} else if (requestCode == FaceUtil.REQUEST_CROP_IMAGE) {// 获取返回数据Bitmap bmp = data.getParcelableExtra("data");// 若返回数据不为null,保存至本地,防止裁剪时未能正常保存if(null != bmp){FaceUtil.saveBitmapToFile(OnlineFaceDemo.this, bmp);}// 获取图片保存路径fileSrc = FaceUtil.getImagePath(OnlineFaceDemo.this);// 获取图片的宽和高BitmapFactory.Options options = new BitmapFactory.Options();options.inJustDecodeBounds = true;mImage = BitmapFactory.decodeFile(fileSrc, options);// 压缩图片options.inSampleSize = Math.max(1, (int) Math.ceil(Math.max((double) options.outWidth / 1024f,(double) options.outHeight / 1024f)));options.inJustDecodeBounds = false;mImage = BitmapFactory.decodeFile(fileSrc, options);// 若mImageBitmap为空则图片信息不能正常获取if(null == mImage) {showTip("图片信息无法正常获取!");return;}// 部分手机会对图片做旋转,这里检测旋转角度int degree = FaceUtil.readPictureDegree(fileSrc);if (degree != 0) {// 把图片旋转为正的方向mImage = FaceUtil.rotateImage(degree, mImage);}ByteArrayOutputStream baos = new ByteArrayOutputStream();//可根据流量及网络状况对图片进行压缩press(pressFormat.JPEG, 80, baos);mImageData = baos.toByteArray();((ImageView) findViewById(R.id.online_img)).setImageBitmap(mImage);}if (resultCode == RESULT_OK) {switch (requestCode) {//拍照完成回调case CODE_CAMERA_REQUEST:cropImageUri = Uri.fromFile(fileCropUri);PhotoUtils.cropImageUri(this, imageUri, cropImageUri, 1, 1, OUTPUT_X, OUTPUT_Y, CODE_RESULT_REQUEST);break;//访问相册完成回调case CODE_GALLERY_REQUEST:cropImageUri = Uri.fromFile(fileCropUri);Uri newUri = Uri.parse(PhotoUtils.getPath(this, data.getData()));if (Build.VERSION.SDK_INT >= Build.VERSION_CODES.N) {newUri = FileProvider.getUriForFile(this, "com.zz.fileprovider", new File(newUri.getPath()));}PhotoUtils.cropImageUri(this, newUri, cropImageUri, 1, 1, OUTPUT_X, OUTPUT_Y, CODE_RESULT_REQUEST);break;case CODE_RESULT_REQUEST:Bitmap bitmap = PhotoUtils.getBitmapFromUri(cropImageUri, this);if (bitmap != null) {((ImageView) findViewById(R.id.online_img)).setImageBitmap(bitmap);mImage = bitmap;ByteArrayOutputStream baos = new ByteArrayOutputStream();//可根据流量及网络状况对图片进行压缩press(pressFormat.JPEG, 80, baos);mImageData = baos.toByteArray();}break;default:}}}@Overridepublic void finish() {if (null != mProDialog) {mProDialog.dismiss();}super.finish();}private void updateGallery(String filename) {MediaScannerConnection.scanFile(this, new String[] {filename}, null,new MediaScannerConnection.OnScanCompletedListener() {@Overridepublic void onScanCompleted(String path, Uri uri) {}});}private void showTip(final String str) {mToast.setText(str);mToast.show();}}

其中需要我们新建一个类,为了专门完成调用系统相机和相册,也是为了替代项目中FaceUtil类,因为他不适配Android7.0

public class PhotoUtils {private static final String TAG = "PhotoUtils";/*** @param activity 当前activity* @param imageUri 拍照后照片存储路径* @param requestCode 调用系统相机请求码*/public static void takePicture(Activity activity, Uri imageUri, int requestCode) {//调用系统相机Intent intentCamera = new Intent();intentCamera.setAction(MediaStore.ACTION_IMAGE_CAPTURE);//将拍照结果保存至photo_file的Uri中,不保留在相册中intentCamera.putExtra(MediaStore.EXTRA_OUTPUT, imageUri);activity.startActivityForResult(intentCamera, requestCode);}/*** @param activity 当前activity* @param requestCode 打开相册的请求码*/public static void openPic(Activity activity, int requestCode) {Intent photoPickerIntent = new Intent(Intent.ACTION_GET_CONTENT);photoPickerIntent.setType("image/*");activity.startActivityForResult(photoPickerIntent, requestCode);}/*** @param activity 当前activity* @param orgUri剪裁原图的Uri* @param desUri剪裁后的图片的Uri* @param aspectXX方向的比例* @param aspectYY方向的比例* @param width 剪裁图片的宽度* @param height剪裁图片高度* @param requestCode 剪裁图片的请求码*/public static void cropImageUri(Activity activity, Uri orgUri, Uri desUri, int aspectX, int aspectY, int width, int height, int requestCode) {Intent intent = new Intent("com.android.camera.action.CROP");if (Build.VERSION.SDK_INT >= Build.VERSION_CODES.N) {intent.addFlags(Intent.FLAG_GRANT_READ_URI_PERMISSION);}intent.setDataAndType(orgUri, "image/*");//发送裁剪信号intent.putExtra("crop", "true");intent.putExtra("aspectX", aspectX);intent.putExtra("aspectY", aspectY);intent.putExtra("outputX", width);intent.putExtra("outputY", height);intent.putExtra("scale", true);//将剪切的图片保存到目标Uri中intent.putExtra(MediaStore.EXTRA_OUTPUT, desUri);//1-false用uri返回图片//2-true直接用bitmap返回图片(此种只适用于小图片,返回图片过大会报错)intent.putExtra("return-data", false);intent.putExtra("outputFormat", pressFormat.JPEG.toString());intent.putExtra("noFaceDetection", true);activity.startActivityForResult(intent, requestCode);}/*** 读取uri所在的图片** @param uri图片对应的Uri* @param mContext 上下文对象* @return 获取图像的Bitmap*/public static Bitmap getBitmapFromUri(Uri uri, Context mContext) {try {Bitmap bitmap = MediaStore.Images.Media.getBitmap(mContext.getContentResolver(), uri);return bitmap;} catch (Exception e) {e.printStackTrace();return null;}}/*** @param context 上下文对象* @param uri当前相册照片的Uri* @return 解析后的Uri对应的String*/@SuppressLint("NewApi")public static String getPath(final Context context, final Uri uri) {final boolean isKitKat = Build.VERSION.SDK_INT >= Build.VERSION_CODES.KITKAT;String pathHead = "file:///";// DocumentProviderif (isKitKat && DocumentsContract.isDocumentUri(context, uri)) {// ExternalStorageProviderif (isExternalStorageDocument(uri)) {final String docId = DocumentsContract.getDocumentId(uri);final String[] split = docId.split(":");final String type = split[0];if ("primary".equalsIgnoreCase(type)) {return pathHead + Environment.getExternalStorageDirectory() + "/" + split[1];}}// DownloadsProviderelse if (isDownloadsDocument(uri)) {final String id = DocumentsContract.getDocumentId(uri);final Uri contentUri = ContentUris.withAppendedId(Uri.parse("content://downloads/public_downloads"), Long.valueOf(id));return pathHead + getDataColumn(context, contentUri, null, null);}// MediaProviderelse if (isMediaDocument(uri)) {final String docId = DocumentsContract.getDocumentId(uri);final String[] split = docId.split(":");final String type = split[0];Uri contentUri = null;if ("image".equals(type)) {contentUri = MediaStore.Images.Media.EXTERNAL_CONTENT_URI;} else if ("video".equals(type)) {contentUri = MediaStore.Video.Media.EXTERNAL_CONTENT_URI;} else if ("audio".equals(type)) {contentUri = MediaStore.Audio.Media.EXTERNAL_CONTENT_URI;}final String selection = "_id=?";final String[] selectionArgs = new String[]{split[1]};return pathHead + getDataColumn(context, contentUri, selection, selectionArgs);}}// MediaStore (and general)else if ("content".equalsIgnoreCase(uri.getScheme())) {return pathHead + getDataColumn(context, uri, null, null);}// Fileelse if ("file".equalsIgnoreCase(uri.getScheme())) {return pathHead + uri.getPath();}return null;}/*** Get the value of the data column for this Uri. This is useful for* MediaStore Uris, and other file-based ContentProviders.** @param context The context.* @param uri The Uri to query.* @param selection(Optional) Filter used in the query.* @param selectionArgs (Optional) Selection arguments used in the query.* @return The value of the _data column, which is typically a file path.*/private static String getDataColumn(Context context, Uri uri, String selection, String[] selectionArgs) {Cursor cursor = null;final String column = "_data";final String[] projection = {column};try {cursor = context.getContentResolver().query(uri, projection, selection, selectionArgs, null);if (cursor != null && cursor.moveToFirst()) {final int column_index = cursor.getColumnIndexOrThrow(column);return cursor.getString(column_index);}} finally {if (cursor != null)cursor.close();}return null;}/*** @param uri The Uri to check.* @return Whether the Uri authority is ExternalStorageProvider.*/private static boolean isExternalStorageDocument(Uri uri) {return "com.android.externalstorage.documents".equals(uri.getAuthority());}/*** @param uri The Uri to check.* @return Whether the Uri authority is DownloadsProvider.*/private static boolean isDownloadsDocument(Uri uri) {return "com.android.providers.downloads.documents".equals(uri.getAuthority());}/*** @param uri The Uri to check.* @return Whether the Uri authority is MediaProvider.*/private static boolean isMediaDocument(Uri uri) {return "com.android.providers.media.documents".equals(uri.getAuthority());}}

运行项目安装app,

首先是语音听写,点击开始我们就可以说话了,他也会弹出一个对话框显示正在录音,你也可以再点击一下屏幕,它会停止录音。这个听写的准确度,一般还可以,但是对于声音相似的单词就容易错。然后使用这个听写是不需要流量的。

然后是在线语音合成,其实就是把文字语音播放出来,与语音听写相对立。这个功能需要流量,然后我们可以选择发音人。

最后一个是声纹密码,首先输入authId,这个其实就是相当于用户名,你就随便输入几个字母,然后点击获取密码,然后点击声纹注册再点击开始录音,他会让你读一段数字,这个录音要进行五次。然后点击1:1验证,再点击开始录音,这个时候他会让你读一段数字,然后他判断你是否是这个authId所代表的用户。

最后是人脸识别,首先是填写authid,然后是选图(调用系统相册)或者拍照(调用系统相机),注册。注册成功后,你就可以通过再次选图或者拍照,点击1:1验证,可以通过两次图片判断是否是同一个人。他还有人脸模型删除,和1:N验证

本内容不代表本网观点和政治立场,如有侵犯你的权益请联系我们处理。
网友评论
网友评论仅供其表达个人看法,并不表明网站立场。