UAV

Deep Q Learning:

Here are some good DQN Python codes. They are all free to be downloaded. You need to use Python > 3.7 and Tensorflow >2.0 to run them.

  1. https://github.com/anita-hu/TF2-RL
  2. https://github.com/chagmgang/tf2.0_reinforcement_learning
  3. https://github.com/marload/DeepRL-TensorFlow2

Deep Reinforcement Learning:

Here are some good DQN Python codes. They are all free to be downloaded. You need to use Python > 3.7 and Tensorflow >2.0 to run them.

  1. https://github.com/anita-hu/TF2-RL
  2. https://github.com/chagmgang/tf2.0_reinforcement_learning
  3. https://github.com/marload/DeepRL-TensorFlow2

UAV Communications and Computing Publications:

  1. L. Zhang, B. Jabbari and N. Ansari, “Deep Reinforcement Learning Driven UAV-assisted Edge Computing,” IEEE Internet of Things Journal, vol. 9, no. 24, pp. 25449-25459, Dec. 2022.
  2. L. Zhang, B. Jabbari and N. Ansari, “Machine Learning Driven UAV-assisted Edge Computing,” Proc. IEEE Wireless Communications and Networking Conference (WCNC), pp. 2220-2225, Apr. 2022.
  3. L. Zhang and J. Chakareski, “UAV-Assisted Edge Computing and Streaming for Wireless Virtual Reality,” accepted for publication in IEEE Transactions on Vehicular Technology, Jan. 2022.
  4. L. Zhang and N. Ansari, “Optimizing the Operation Cost for UAV-aided Mobile Edge Computing,” IEEE Transactions on Vehicular Technology, vol. 70, no. 6, pp. 6085-6093, Jun. 2021.
  5. L. Zhang and N. Ansari, “Latency-Aware IoT Service Provisioning in UAV-Aided Mobile-Edge Computing Networks,” IEEE Internet of Things Journal, vol. 7, no. 10, pp. 10573-10580, Oct. 2020.
  6. L. Zhang and N. Ansari, “Optimizing the Deployment and Throughput of DBSs for Uplink Communications,” IEEE Open Journal of Vehicular Technology, vol. 1, pp. 18-28, Jan. 2020.
  7. N. Ansari and L. Zhang, “Flexible Backhaul-aware DBS-aided HetNet with IBFD Communications (invited paper),” ICT Express, Mar. 2020, DOI: https://doi.org/10.1016/j.icte.2019.08.003.
  8. N. Ansari, Q. Fan, X. Sun and L. Zhang, “ SoarNet,” in IEEE Wireless Communications, vol. 26, no. 6, pp. 37-43, Dec. 2019.
  9. L. Zhang and N. Ansari, “Approximate Algorithms for 3-D Placement of IBFD Enabled Drone-mounted Base-Stations,” IEEE Transactions on Vehicular Technology, vol. 68, no. 8, pp. 7715-7722, Jun. 2019.
  10. L. Zhang and N. Ansari, “A Framework for 5G Networks with In-band Full-duplex Enabled Drone-mounted Base-stations,” IEEE Wireless Communications, vol. 26, no. 5, pp. 121-127, Oct. 2019.
  11. L. Zhang and N. Ansari, “On the Number and 3-D Placement of In-Band Full-Duplex Enabled Drone-mounted Base-stations,” IEEE Wireless Communications Letters, vol. 8, no. 1, pp. 221-224, Feb. 2019.
  12. L. Zhang, Q. Fan and N. Ansari, “3-D Drone-Base-Station Placement with In-Band Full-Duplex Communications,” IEEE Communications Letters, vol. 22, no. 9, pp. 1902-1905, Sept. 2018.