Skip to content

Tensorflow - #7470

Merged
ev-mp merged 192 commits into
realsenseai:developmentfrom
nohayassin:tensorflow
Oct 5, 2020
Merged

ev-mp merged 192 commits into
realsenseai:developmentfrom
nohayassin:tensorflow

Conversation

@nohayassin

Copy link
Copy Markdown
Contributor

Adding Tensorflow wrapper.
Track on: DSO-15262

@ev-mp ev-mp mentioned this pull request Oct 4, 2020
@nohayassin
nohayassin changed the base branch from master to development October 4, 2020 11:08

@ev-mp ev-mp left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well done - several cosmetic fixes

Comment thread wrappers/tensorflow/README.md Outdated
feed_dict={image_tensor: image_expanded})
```

Finally we will assign random persistent color to each detection class and draw a bounding box around the object. We filter out low confidence predictions using `score` output.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Finally,

Comment thread wrappers/tensorflow/README.md Outdated
verts = np.asanyarray(points.get_vertices()).view(np.float32).reshape(-1, W, 3) # xyz
```

This allows us to query XYZ coordinates of each detected object and to seperate individual coordinates (in meters):

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

separate

Comment thread wrappers/tensorflow/README.md Outdated

## Part 3 - Deploying TensorFlow model using OpenCV

While TensorFlow is convinient to install and use, it is not as convinient as OpenCV. OpenCV is ported to most platforms and is well optimised for various types of CPUs. It also comes with built-in DNN module capable of loading and using TensorFlow models without having TensorFlow (or its dependencies) installed.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

convenient

Comment thread wrappers/tensorflow/README.md Outdated
Unet offers significant advantages compared to classic autoencoder architecture, improving edge fidelity (see image below).

![foxdemo](images/Unet.PNG)
###### The image is taken from the article reffered above.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

referred

Comment thread wrappers/tensorflow/README.md Outdated
very good at detecting more and more features, the first few layers of a convolution network capture a very small semantic information and lower level
features, as you go down these features become larger and larger, but when we throw away information the CNN
knows only approximate location about where those features are.
When we upsample we get the lost information back (by the concatination process)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

concatenation

Comment thread wrappers/tensorflow/README.md Outdated
#### Data Augmentation
To help the neural network learning image features we decide to crop input images into tiles of 128x128 pixels.

Each ground truth image has a corressponding depth and infrared image. Given that, the dataset is augmented as following:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

corresponding

Comment thread wrappers/tensorflow/README.md Resolved
Comment thread wrappers/tensorflow/README.md Resolved
Comment thread wrappers/tensorflow/README.md Resolved
Comment thread wrappers/tensorflow/README.md Resolved

@ev-mp ev-mp left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well done!

@ev-mp
ev-mp merged commit 86967a1 into realsenseai:development Oct 5, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants