OStack程序员社区-中国程序员成长平台

标题: ios - 使用 MTKView 显示 JPEG 图像 [打印本页]

---

作者: 菜鸟教程小白    时间: 2022-12-12 09:43
标题: ios - 使用 MTKView 显示 JPEG 图像

有没有办法通过 MTKView 和 MTLBuffer(以及在 iPhone 6+ 中)显示 JPEG 图像。我已经通过以下方式进行了尝试(这只是测试):

- (id<MTLBuffer>)testBuffer
{
    if (!_testBuffer)
    {
// 
        NSString *path = [[NSBundle mainBundle] pathForResource"testImage" ofType"jpg"];
        NSData *imageData = [NSData dataWithContentsOfFile:path];
        _testBuffer = [self.device newBufferWithBytes:imageData.bytes length:imageData.length options:MTLResourceCPUCacheModeWriteCombined];
    }

    return _testBuffer;
}

- (void)drawInMTKViewMTKView *)view
{
    MTLRenderPassDescriptor* renderPassDescriptor = view.currentRenderPassDescriptor;
    id <MTLCommandBuffer> commandBuffer = [_commandQueue commandBuffer];
    id <MTLRenderCommandEncoder> renderEncoder = [commandBuffer renderCommandEncoderWithDescriptor:renderPassDescriptor];
    [renderEncoder drawPrimitives:MTLPrimitiveTypePoint indirectBuffer:self.testBuffer indirectBufferOffset:0];
    [renderEncoder endEncoding];
    [commandBuffer presentDrawable:view.currentDrawable];
    [commandBuffer commit];
}

我在此方法调用中遇到错误:

[renderEncoder drawPrimitives:MTLPrimitiveTypePoint indirectBuffer:self.testBuffer indirectBufferOffset:0];

/BuildRoot/Library/Caches/com.apple.xbs/Sources/Metal/Metal-54.31/ToolsLayers/Debug/MTLDebugRenderCommandEncoder.mm:2123: failed assertion `-[MTLDebugRenderCommandEncoder drawPrimitives:indirectBuffer:indirectBufferOffset:] is only supported on MTLFeatureSet_iOS_GPUFamily3_v1 and later'

这是因为只有 iPhone 6s(+) 支持此 API .

而且我认为我做错了什么。也许我需要换个方向思考。有人可以帮助我或指出正确的方向吗？ 谢谢。

---

Best Answer-推荐答案

没有简单的方法可以使用 MTLBuffer 通过 MTKView 呈现图像数据。在这种情况下，您必须为正确的输出纹理准备正确的像素表示，该输出纹理用于由 MTKView 在可绘制层中显示。最简单的方法是使用 MTKTextureLoader，或者从 UIImage/CGImage 实例加载数据到 MTLTexture 对象。

我做了一个类似的实验，使用 MTL 层和 MTLTexture(而不是 MTLBuffer)在 iOS 设备上呈现图像，我已经决定了显示图像的最佳方式(如果只需要:显示图像)它使用直通无需渲染的内核函数。

在 Swift2 中，如下所示:

...

let textureLoader = MTKTextureLoader(device: self.device!)
if let image = UIImage(named: file){
   imageTexture = try! textureLoader.newTextureWithCGImage(image.CGImage!, options: nil)
   threadGroups = MTLSizeMake(
                (imageTexture.width+threadGroupCount.width)/threadGroupCount.width,
                (imageTexture.height+threadGroupCount.height)/threadGroupCount.height, 1)
    }
} 
...  

let function:MTLFunction! = library.newFunctionWithName("kernel_passthrough")
...
pipeline = try! self.device.newComputePipelineStateWithFunction(function)
...
let commandBuffer = commandQueue.commandBuffer()
let encoder = commandBuffer.computeCommandEncoder()
encoder.setComputePipelineState(pipeline)
encoder.setTexture(actualImageTexture, atIndex: 0)
encoder.setTexture(metalView.currentDrawable!.texture, atIndex: 1)
encoder.setBuffer(self.saturationUniform, offset: 0, atIndex: 0)
encoder.dispatchThreadgroups(threadGroups!, threadsPerThreadgroup: threadGroupCount)
encoder.endEncoding()
commandBuffer.presentDrawable(metalView.currentDrawable!)
commandBuffer.commit()
...

在 Metal 着色文件中:

kernel void kernel_passthrough(texture2d<float, access::read> inTexture [[texture(0)]],
                           texture2d<float, access::write> outTexture [[texture(1)]],
                           uint2 gid [[thread_position_in_grid]])
{
     float4 inColor   = inTexture.read(gid); 
     //
     // flip texture vertically if it needs to display with right orientation 
     //
     outTexture.write(inColor, gid);
}

完整示例来源:ImageMetalling-00

关于ios - 使用 MTKView 显示 JPEG 图像，我们在Stack Overflow上找到一个类似的问题： https://stackoverflow.com/questions/33605241/

---

欢迎光临 OStack程序员社区-中国程序员成长平台 (https://ostack.cn/)

Powered by Discuz! X3.4