VisionOS Support for VisionOSVideoComponent

[yosun]

Please support VisionOS

https://docs.unity3d.com/Packages/com.unity.polyspatial.visionos@1.0/manual/VideoComponent.html?q=video

[yasirkula]

NativeGallery returns the picked video's path. How would you prefer it to behave with VisionOS?

[randalhucker]

@yasirkula To clarify, is NativeGallery confirmed to work with VisionOS? I've been fighting it all day with no luck, but would love to find out that I had just been doing something incorrectly! :)

[yasirkula]

I've heard from a couple of users that it doesn't work on VisionOS. I don't have a Vision Pro to test it myself but for the time being, we can say that it isn't supported.

[414726193]

You can use an emulator to test
Vision Pro is support PHPickerViewController.

[yasirkula]

I don't have access to a Mac workstation either and for this task, I'm relying on a fix from a volunteer (if anyone fixes the issue, please create a Pull Request).

[oOtroyOo]

lol 🤣，good question.

[randalhucker]

@yasirkula Sorry for taking so long to get back to this. I'm not very familiar with how your package worked (I only was looking for ways to get to the Gallery and stumbled here before I read that it wasn't supported), but I have a solution that prompts the gallery so that you can choose images/videos. It doesn't allow actually taking photos (VisionOS doesn't give you that permission to camera data) - but I could share that with you if it's something you think would be useful.

[yasirkula]

@randalhucker It sounds very useful for VisionOS, so I'd very much like to see your solution 👑

[randyhucker-physna]

@yasirkula I'll send everything in this thread when I get home tonight.

[414726193]

@yasirkula Sorry for taking so long to get back to this. I'm not very familiar with how your package worked (I only was looking for ways to get to the Gallery and stumbled here before I read that it wasn't supported), but I have a solution that prompts the gallery so that you can choose images/videos. It doesn't allow actually taking photos (VisionOS doesn't give you that permission to camera data) - but I could share that with you if it's something you think would be useful.

I really need it. Can you share it with me

[randyhucker-physna]

@yasirkula

Below is everything you need. All you need to do is call ImagePicker inside of a sheet or something similar: ImagePicker()

I call it like this .sheet(isPresented: $isPickerShowing) { ImagePicker() }

This does a few things... the 'selectionLimit' is how many 'items' you can pick from the gallery, and the filter is the type (i.e. photos, videos, etc.)

There are many ways to get the info out, but for me I needed one photo, so I have a class - CurrentImage - that holds the id, original extension, and the image data. You can see how I'm assigning them below.

struct ImagePicker: UIViewControllerRepresentable {
    func makeUIViewController(context: Context) -> some UIViewController {
        var config = PHPickerConfiguration(photoLibrary: .shared())
        config.selectionLimit = 1
        config.filter = .images

        let vc = PHPickerViewController(configuration: config)
        vc.delegate = context.coordinator
        return vc
    }

    func updateUIViewController(_ uiViewController: UIViewControllerType, context: Context) {}

    func makeCoordinator() -> PhotoPickerCoordinator {
        return PhotoPickerCoordinator()
    }
}

class PhotoPickerCoordinator: NSObject, PHPickerViewControllerDelegate {
    func picker(_ picker: PHPickerViewController, didFinishPicking results: [PHPickerResult]) {
        picker.dismiss(animated: true, completion: nil)

        results.forEach { result in
            result.itemProvider.loadFileRepresentation(forTypeIdentifier: UTType.image.identifier) { url, error in
                guard let url = url, error == nil else { return }

                let fileName = url.deletingPathExtension().lastPathComponent
                let fileExtension = url.pathExtension

                CurrentImage.shared
                    .with(imageName: fileName)
                    .with(imageExtension: fileExtension)

                result.itemProvider.loadObject(ofClass: UIImage.self) { image, _ in
                    guard let image = image as? UIImage else { return }

                    CurrentImage.shared.with(image: image)
                }
            }
        }
    }
}

[414726193]

@yasirkula

Below is everything you need. All you need to do is call ImagePicker inside of a sheet or something similar: ImagePicker()

I call it like this .sheet(isPresented: $isPickerShowing) { ImagePicker() }

This does a few things... the 'selectionLimit' is how many 'items' you can pick from the gallery, and the filter is the type (i.e. photos, videos, etc.)

There are many ways to get the info out, but for me I needed one photo, so I have a class - CurrentImage - that holds the id, original extension, and the image data. You can see how I'm assigning them below.

struct ImagePicker: UIViewControllerRepresentable {
    func makeUIViewController(context: Context) -> some UIViewController {
        var config = PHPickerConfiguration(photoLibrary: .shared())
        config.selectionLimit = 1
        config.filter = .images

        let vc = PHPickerViewController(configuration: config)
        vc.delegate = context.coordinator
        return vc
    }

    func updateUIViewController(_ uiViewController: UIViewControllerType, context: Context) {}

    func makeCoordinator() -> PhotoPickerCoordinator {
        return PhotoPickerCoordinator()
    }
}

class PhotoPickerCoordinator: NSObject, PHPickerViewControllerDelegate {
    func picker(_ picker: PHPickerViewController, didFinishPicking results: [PHPickerResult]) {
        picker.dismiss(animated: true, completion: nil)

        results.forEach { result in
            result.itemProvider.loadFileRepresentation(forTypeIdentifier: UTType.image.identifier) { url, error in
                guard let url = url, error == nil else { return }

                let fileName = url.deletingPathExtension().lastPathComponent
                let fileExtension = url.pathExtension

                CurrentImage.shared
                    .with(imageName: fileName)
                    .with(imageExtension: fileExtension)

                result.itemProvider.loadObject(ofClass: UIImage.self) { image, _ in
                    guard let image = image as? UIImage else { return }

                    CurrentImage.shared.with(image: image)
                }
            }
        }
    }
}

Can you share the full file, I am not an ios developer and do not know how to use this code

[yasirkula]

@RandyHucker Thank you for sharing your code 🌷 I have little-to-none Swift experience but if I understand the key parts correctly, it works similar to NativeGallery. Perhaps VisionOS only works with Swift? How are you creating and displaying a new instance of ImagePicker struct?

[randalhucker]

@yasirkula Yes, it does work very similarly. And I'm not sure if it's convertible to objective-c. I've been coding for the VPro only in Swift. And Swift makes it easy, it has @State variables which essentially force a UI-Update on every mutation. When the user clicks a button, I mutate that isPickerShowing var, and then the UI calls the .sheet method (which is like a popup)