Zero bias Deep Learning Enabled Quick and Reliable Abnormality Detection in IoT. Abnormality detection is essential to the performance of safety critical and latency constrained systems. However, as systems are becoming increasingly complicated with a large quantity of heterogeneous data, conventional statistical change point detection methods are becoming less effective and efficient. Although Deep Learning (DL) and Deep Neural Networks (DNNs) are increasingly employed to handle heterogeneous data, they still lack theoretic assurable performance and explainability. This paper integrates zero bias DNN and Quickest Event Detection algorithms to provide a holistic framework for quick and reliable detection of both abnormalities and time dependent abnormal events in the Internet of Things (IoT). We first use the zero bias dense layer to increase the explainability of DNN. We provide a solution to convert zero bias DNN classifiers into performance assured binary abnormality detectors. Using the converted abnormality detector, we then present a sequential quickest detection scheme that provides the theoretically assured lowest abnormal event detection delay under false alarm constraints. Finally, we demonstrate the effectiveness of the framework using both massive signal records from real world aviation communication systems and simulated data. Code and data of our work is available at url https github.com pcwhy AbnormalityDetectionInZbDNN


The q Gauss Newton method for unconstrained nonlinear optimization. A q Gauss Newton algorithm is an iterative procedure that solves nonlinear unconstrained optimization problems based on minimization of the sum squared errors of the objective function residuals. Main advantage of the algorithm is that it approximates matrix of q second order derivatives with the first order q Jacobian matrix. For that reason, the algorithm is much faster than q steepest descent algorithms. The convergence of q GN method is assured only when the initial guess is close enough to the solution. In this paper the influence of the parameter q to the non linear problem solving is presented through three examples. The results show that the q GD algorithm finds an optimal solution and speeds up the iterative procedure.


Robust Optimization of Instantaneous Beamforming and Quasi static Phase Shifts in an IRS assisted Multi Cell Network. The impacts of channel estimation errors, inter cell interference, phase adjustment cost, and computation cost on an intelligent reflecting surface (IRS) assisted system are severe in practice but have been ignored for simplicity in most existing works. In this paper, we investigate a multi antenna base station (BS) serving a single antenna user with the help of a multi element IRS in a multi cell network with inter cell interference. We consider imperfect channel state information (CSI) at the BS, i.e., imperfect CSIT, and focus on the robust optimization of the BS's instantaneous CSI adaptive beamforming and the IRS's quasi static phase shifts in two scenarios. In the scenario of coding over many slots, we formulate a robust optimization problem to maximize the user's ergodic rate. In the scenario of coding within each slot, we formulate a robust optimization problem to maximize the user's average goodput under the successful transmission probability constraints. The robust optimization problems are challenging two timescale stochastic non convex problems. In both scenarios, we obtain closed form robust beamforming designs for any given phase shifts and more tractable stochastic non convex approximate problems only for the phase shifts. Besides, we propose an iterative algorithm to obtain a Karush Kuhn Tucker (KKT) point of each of the stochastic problems for the phase shifts. It is worth noting that the proposed methods offer closed form robust instantaneous CSI adaptive beamforming designs which can promptly adapt to rapid CSI changes over slots and robust quasi static phase shift designs of low computation and phase adjustment costs in the presence of imperfect CSIT and inter cell interference. Numerical results further demonstrate the notable gains of the proposed robust joint designs over existing ones and reveal the practical values of the proposed solutions.


Combined Hydrothermal Liquefaction of Polyurethane and Lignocellulosic Biomass for improved carbon recovery. Due to the high versatility of Polyurethane (PUR), its share amongst synthetic polymers to manufacture consumer goods is increasing. This study proposes, tests and validates through pilot processing a highly efficient method for carbon recovery of PUR and in the form of an oil phase concentrated in carbon using hydrothermal liquefaction (HTL). Hot liquid water mixed with PUR residues and a lignocellulosic material (two species of Miscanthus) were treated at subcritical water temperatures, generating an oil phase rich in hydrocarbons. A high synergistic effect in the co liquefaction was observed, leading to a carbon and chemical energy recovery to the oil of 71 and 75 respectively. Pilot plant processing, using optimized process parameters, yielded a total process efficiency, accounting heating utilities, of 61 , resulting in a 3.2 ratio of energy return over investment. Using spectroscopic and high resolution mass spectrometry analysis the oil revealed a high content of nitrogen hetero aromatic and polyol compounds. The high synergy observed for the co liquefaction of PUR and miscanthus is attributed to recombination of synthetic and biological materials, specifically due to aromatics present in the media and nitrogen containing compounds recombination. The results show that HTL can be an efficient method for carbon recovery of PUR aided by biomass.


The Szemer ' e di Trotter type theorem in matrix rings and its application. In this paper, we study a Szemer ' e di Trotter type theorem in matrix rings. More precisely, let mathcal P be a set of points and mathcal L be a set of lines in M 2( mathbb F q) times M 2( mathbb F q) , we have I( mathcal P , mathcal L ) left left (p, ell) in mathcal P times mathcal L , , p in ell right right leq dfrac mathcal P mathcal L q 4 sqrt 2 q 7 2 sqrt mathcal P mathcal L . We also use this theorem to give other proofs for some recent sum product type estimates due to Karabulut, Koh, Pham, Shen, and the second listed author.


Acoustic absorption and generation in ducts of smoothly varying area sustaining a mean flow and a mean temperature gradient. In ducts with varying cross sectional area and sustaining a subsonic non isentropic mean flow, the axially varying flow conditions affect the acoustic energy balance of the system. This is significant in understanding and controlling thermo acoustic phenomena, particularly in combustors. This work aims at quantifying the acoustic energy change in such configurations, using the acoustic absorption coefficient, Delta . The acoustic response of the duct to acoustic forcing is determined using an analytical model, neglecting the effect of entropy fluctuations on the acoustic field, and subsequently, Delta is estimated. The model predictions of Delta are validated using a linearised Euler equations (LEEs) solver. The model was found to be accurate for Mach numbers below 0.25 , provided the lower frequency limit set by the analytical solution is satisfied. For conically varying area ducts with linear mean temperature gradient, it was observed that Delta showed very little dependence on frequency, and that the absolute value of Delta tended to be maximised when the upstream boundary was anechoic rather than non anechoic. More importantly, Delta was also observed to show stronger dependence on the mean temperature gradient than area gradient variation for such configurations. Further parametric and optimisation studies for Delta revealed a crucial finding that a positive mean temperature gradient, representing a heated duct caused acoustic energy absorption. Similarly, a negative mean temperature gradient, representing a cooled duct caused acoustic energy generation a key result of this analysis. This behaviour was shown to be consistent with a simplified analysis of the acoustic energy balance. Based on this finding, a linearly proportional reduction in acoustic energy generation was achieved by changing the mean temperature gradient.


ConTIG Continuous Representation Learning on Temporal Interaction Graphs. Representation learning on temporal interaction graphs (TIG) is to model complex networks with the dynamic evolution of interactions arising in a broad spectrum of problems. Existing dynamic embedding methods on TIG discretely update node embeddings merely when an interaction occurs. They fail to capture the continuous dynamic evolution of embedding trajectories of nodes. In this paper, we propose a two module framework named ConTIG, a continuous representation method that captures the continuous dynamic evolution of node embedding trajectories. With two essential modules, our model exploit three fold factors in dynamic networks which include latest interaction, neighbor features and inherent characteristics. In the first update module, we employ a continuous inference block to learn the nodes' state trajectories by learning from time adjacent interaction patterns between node pairs using ordinary differential equations. In the second transform module, we introduce a self attention mechanism to predict future node embeddings by aggregating historical temporal interaction information. Experiments results demonstrate the superiority of ConTIG on temporal link prediction, temporal node recommendation and dynamic node classification tasks compared with a range of state of the art baselines, especially for long interval interactions prediction.


Coupling between multiple antennas through a plasma cylinder. The coupling physics between multiple antennas separated axially along a plasma cylinder is investigated. Experiments are carried out on a recently built device Physics ANd Thruster oriented HElicon Research (PANTHER), with an upgrade of second stage antennas. Mutual induction currents are measured in detail. It is found that the existence of plasma column going through these antennas increase the coupling effects among them significantly. Theoretical analyses from the perspectives of transformer and magnetic permeability and moment confirm the reasonability of this phenomenon. This work is of particular interest for electrodeless plasma source or thruster which employs multiple antennas for ionisation and acceleration.


Reconstructibility of the K r count from n 1 cards. The reconstruction conjecture by Kelly and Ulam was posed in the 40s and is still widely open today. A lemma by Kelly states that one can count subgraphs on at most n 1 vertices given all the cards. We show that the clique count in G is reconstructable for all but one size of the clique from n 1 cards. We extend this result by showing for graphs with average degree at most n 4 1 we can reconstruct the K r count for all r , and that for r le log n we can reconstruct the K r count for every graph.


Neural Emotion Director Speech preserving semantic control of facial expressions in "in the wild" videos. In this paper, we introduce a novel deep learning method for photo realistic manipulation of the emotional state of actors in "in the wild" videos. The proposed method is based on a parametric 3D face representation of the actor in the input scene that offers a reliable disentanglement of the facial identity from the head pose and facial expressions. It then uses a novel deep domain translation framework that alters the facial expressions in a consistent and plausible manner, taking into account their dynamics. Finally, the altered facial expressions are used to photo realistically manipulate the facial region in the input scene based on an especially designed neural face renderer. To the best of our knowledge, our method is the first to be capable of controlling the actor's facial expressions by even using as a sole input the semantic labels of the manipulated emotions, while at the same time preserving the speech related lip movements. We conduct extensive qualitative and quantitative evaluations and comparisons, which demonstrate the effectiveness of our approach and the especially promising results that we obtain. Our method opens a plethora of new possibilities for useful applications of neural rendering technologies, ranging from movie post production and video games to photo realistic affective avatars.


Toy examples for effective concentration bounds. In this note we prove a spectral gap for various Markov chains on various functional spaces. While proving that a spectral gap exists is relatively common, explicit estimates seems somewhat rare.These estimates are then used to apply the concentration inequalities of "Effective limit theorems for Markov chains with a spectral gap" (most of the present material was part of Section 3 of that article, which has been reduced to its core in the published version).


Weakly Supervised Contrastive Learning for Chest X Ray Report Generation. Radiology report generation aims at generating descriptive text from radiology images automatically, which may present an opportunity to improve radiology reporting and interpretation. A typical setting consists of training encoder decoder models on image report pairs with a cross entropy loss, which struggles to generate informative sentences for clinical diagnoses since normal findings dominate the datasets. To tackle this challenge and encourage more clinically accurate text outputs, we propose a novel weakly supervised contrastive loss for medical report generation. Experimental results demonstrate that our method benefits from contrasting target reports with incorrect but semantically close ones. It outperforms previous work on both clinical correctness and text generation metrics for two public benchmarks.


Interpretable Attention Guided Network for Fine grained Visual Classification. Fine grained visual classification (FGVC) is challenging but more critical than traditional classification tasks. It requires distinguishing different subcategories with the inherently subtle intra class object variations. Previous works focus on enhancing the feature representation ability using multiple granularities and discriminative regions based on the attention strategy or bounding boxes. However, these methods highly rely on deep neural networks which lack interpretability. We propose an Interpretable Attention Guided Network (IAGN) for fine grained visual classification. The contributions of our method include i) an attention guided framework which can guide the network to extract discriminitive regions in an interpretable way ii) a progressive training mechanism obtained to distill knowledge stage by stage to fuse features of various granularities iii) the first interpretable FGVC method with a competitive performance on several standard FGVC benchmark datasets.


Optimal Reaction Coordinates Variational Characterization and Sparse Computation. Reaction Coordinates (RCs) are indicators of hidden, low dimensional mechanisms that govern the long term behavior of high dimensional stochastic processes. We present a novel and general variational characterization of optimal RCs and provide conditions for their existence. Optimal RCs are minimizers of a certain loss function and reduced models based on them guarantee very good approximation of the long term dynamics of the original high dimensional process. We show that, for slow fast systems, metastable systems, and other systems with known good RCs, the novel theory reproduces previous insight. Remarkably, the numerical effort required to evaluate the loss function scales only with the complexity of the underlying, low dimensional mechanism, and not with that of the full system. The theory provided lays the foundation for an efficient and data sparse computation of RCs via modern machine learning techniques.


EPTAS and Subexponential Algorithm for Maximum Clique on Disk and Unit Ball Graphs. A (unit) disk graph is the intersection graph of closed (unit) disks in the plane. Almost three decades ago, an elegant polynomial time algorithm was found for textsc Maximum Clique on unit disk graphs Clark, Colbourn, Johnson Discrete Mathematics '90 . Since then, it has been an intriguing open question whether or not tractability can be extended to general disk graphs. We show that the disjoint union of two odd cycles is never the complement of a disk graph nor of a unit (3 dimensional) ball graph. From that fact and existing results, we derive a simple QPTAS and a subexponential algorithm running in time 2 tilde O (n 2 3 ) for textsc Maximum Clique on disk and unit ball graphs. We then obtain a randomized EPTAS for computing the independence number on graphs having no disjoint union of two odd cycles as an induced subgraph, bounded VC dimension, and linear independence number. This, in combination with our structural results, yields a randomized EPTAS for textsc Max Clique on disk and unit ball graphs. textsc Max Clique on unit ball graphs is equivalent to finding, given a collection of points in mathbb R 3 , a maximum subset of points with diameter at most some fixed value. In stark contrast, textsc Maximum Clique on ball graphs and unit 4 dimensional ball graphs, as well as intersection graphs of filled ellipses (even close to unit disks) or filled triangles is unlikely to have such algorithms. Indeed, we show that, for all those problems, there is a constant ratio of approximation which cannot be attained even in time 2 n 1 varepsilon , unless the Exponential Time Hypothesis fails.


Enhancement of parity violating energy difference of H 2 X 2 molecules by electronic excitation. The parity violating energy difference (PVED) between two enantiomers of a chiral molecule is caused by the weak interaction. Because of the smallness of the PVED, nonzero PVED is yet to be discovered in experimental searches. To detect the PVED, the search for molecules with large PVED values is important. Previously, one of the authors proposed that the PVED may be significantly enhanced in ionized or excited states. The significant enhancement of the PVED in some electronic excited states is proven in this study using H 2 X 2 (X O, S, Se, Te) molecules as examples. The maximum enhancement was an about 360 fold increase for H 2 Se 2 . For the PVED calculation, we employ the finite field perturbation theory (FFPT) within the equation of motion coupled cluster theory based on the exact two component molecular mean field Hamiltonian. The relation between the enhancement of the PVED and the contribution to the PVED from the highest occupied molecular orbital is also examined. The effects of computational elements, such as parameters related to the electron correlation and FFPT on PVED values in excited states of H 2 X 2 molecules are studied.


User Experience Design for E Voting How mental models align with security mechanisms. This paper presents a mobile application for vote casting and vote verification based on the Selene e voting protocol and explains how it was developed and implemented using the User Experience Design process. The resulting interface was tested with 38 participants, and user experience data was collected via questionnaires and semi structured interviews on user experience and perceived security. Results concerning the impact of displaying security mechanisms on UX were presented in a complementary paper. Here we expand on this analysis by studying the mental models revealed during the interviews and compare them with theoretical security notions. Finally, we propose a list of improvements for designs of future voting protocols.


Reward Based Environment States for Robot Manipulation Policy Learning. Training robot manipulation policies is a challenging and open problem in robotics and artificial intelligence. In this paper we propose a novel and compact state representation based on the rewards predicted from an image based task success classifier. Our experiments, using the Pepper robot in simulation with two deep reinforcement learning algorithms on a grab and lift task, reveal that our proposed state representation can achieve up to 97 task success using our best policies.


Relationships Between Hyperelliptic Functions of Genus 2 and Elliptic Functions. The article is devoted to the classical problems about the relationships between elliptic functions and hyperelliptic functions of genus 2. It contains new results, as well as a derivation from them of well known results on these issues. Our research was motivated by applications to the theory of equations and dynamical systems integrable in hyperelliptic functions of genus 2. We consider a hyperelliptic curve V of genus 2 which admits a morphism of degree 2 to an elliptic curve. Then there exist two elliptic curves E i , i 1,2 , and morphisms of degree 2 from V to E i . We construct hyperelliptic functions associated with V from the Weierstrass elliptic functions associated with E i and describe them in terms of the fundamental hyperelliptic functions defined by the logarithmic derivatives of the two dimensional sigma functions. We show that the restrictions of hyperelliptic functions associated with V to the appropriate subspaces in mathbb C 2 are elliptic functions and describe them in terms of the Weierstrass elliptic functions associated with E i . Further, we express the hyperelliptic functions associated with V on mathbb C 2 in terms of the Weierstrass elliptic functions associated with E i . We derive these results by describing the homomorphisms between the Jacobian varieties of the curves V and E i induced by the morphisms from V to E i explicitly.


A Review of 3D Face Reconstruction From a Single Image. 3D face reconstruction is a challenging problem but also an important task in the field of computer vision and graphics. Recently, many researchers put attention to the problem and a large number of articles have been published. Single image reconstruction is one of the branches of 3D face reconstruction, which has a lot of applications in our life. This paper is a review of the recent literature on 3D face reconstruction from a single image.


Crystal Pop Stack Sorting and Type A Crystal Lattices. Given a complex simple Lie algebra mathfrak g and a dominant weight lambda , let mathcal B lambda be the crystal poset associated to the irreducible representation of mathfrak g with highest weight lambda . In the first part of the article, we introduce the emph crystal pop stack sorting operator mathsf Pop lozenge colon mathcal B lambda to mathcal B lambda , a noninvertible operator whose definition extends that of the pop stack sorting map and the recently introduced Coxeter pop stack sorting operators. Every forward orbit of mathsf Pop lozenge contains the minimal element of mathcal B lambda , which is fixed by mathsf Pop lozenge . We prove that the maximum size of a forward orbit of mathsf Pop lozenge is the Coxeter number of the Weyl group of mathfrak g . In the second part of the article, we characterize exactly when a type A crystal is a lattice.


Hausdorff dimension of limsup sets of isotropic rectangles in Heisenberg groups. A formula for the Hausdorff dimension of typical limsup sets generated by randomly distributed isotropic rectangles in Heisenberg groups is derived in terms of directed singular value functions.


Estimation of Playable Piano Fingering by Pitch difference Fingering Matching Model. The existing piano fingering labeling statistical models usually consider the constraints among the fingers and the correlation between fingering and notes, and rarely include the relationship among the notes directly. The limited learned finger transfer rules often cause that some parts of the fingering cannot be playable in fact. And traditional models often adopt the original notes, which cannot help to explore the mapping nature between the pitches and fingering. Inspired from manual ly annotation which acquire the fingering knowledge directly from pitch difference, we proposed a pitch difference sequence and fingering (PdF) matching model. And to get playable fingering, be sides learned finger transfer rules, prior finger transfer knowledge is especially combined into the model. In order to characterize the playable performance of the model, we also presented a new evaluation index named incapable performing fingering rate (IFR). Comprehensive experimental re sults show that compared with the existing state of the art third order hidden Markov labeling model, the general and the highest matching rate of our model increases by 3 and 1.6 respective ly, and the fingering for all scores can be playable.


Pruning the Index Contents for Memory Efficient Open Domain QA. This work presents a novel pipeline that demonstrates what is achievable with a combined effort of state of the art approaches. Specifically, it proposes the novel R2 D2 (Rank twice, reaD twice) pipeline composed of retriever, passage reranker, extractive reader, generative reader and a simple way to combine them. Furthermore, previous work often comes with a massive index of external documents that scales in the order of tens of GiB. This work presents a simple approach for pruning the contents of a massive index such that the open domain QA system altogether with index, OS, and library components fits into 6GiB docker image while retaining only 8 of original index contents and losing only 3 EM accuracy.


Semi Supervised Object Detection with Adaptive Class Rebalancing Self Training. This study delves into semi supervised object detection (SSOD) to improve detector performance with additional unlabeled data. State of the art SSOD performance has been achieved recently by self training, in which training supervision consists of ground truths and pseudo labels. In current studies, we observe that class imbalance in SSOD severely impedes the effectiveness of self training. To address the class imbalance, we propose adaptive class rebalancing self training (ACRST) with a novel memory module called CropBank. ACRST adaptively rebalances the training data with foreground instances extracted from the CropBank, thereby alleviating the class imbalance. Owing to the high complexity of detection tasks, we observe that both self training and data rebalancing suffer from noisy pseudo labels in SSOD. Therefore, we propose a novel two stage filtering algorithm to generate accurate pseudo labels. Our method achieves satisfactory improvements on MS COCO and VOC benchmarks. When using only 1 labeled data in MS COCO, our method achieves 17.02 mAP improvement over supervised baselines, and 5.32 mAP improvement compared with state of the art methods.


The Systematic Design of Non commensurate Impedance Matching Tapers for Ultra Wideband Gradient Index (GRIN) Lens Antennas. We propose a general method for designing wideband matching tapers in inhomogeneous media where phase velocity is coupled to the taper impedance profile. Such tapers are used to match wideband gradient index (GRIN) lens antennas. To simplify fabrication tapers are often constrained to physically uniform layers wherein commensurate line theory cannot predict the frequency response. Therefore, we present a new design algorithm which derives an effective permittivity epsilon eff to equalize the electrical length of commensurate and non commensurate line tapers. The algorithm provides a systematic design method with predictable frequency response for non commensurate line tapers. Nevertheless, there are several unavoidable nonidealities present in such discretized tapers which we discuss and provide recommendations for mitigation. The algorithm is used to design a Klopfenstein taper with return loss better than 15 dB from 8 to 78 GHz. The design is fabricated and measurements agree with simulation across the WR90, WR28, and WR12 bands. An approximate efficiency formula is proposed which predicts aperture efficiency of taper matched lenses without the need for time consuming full wave simulations. Various lenses are designed and compared to highlight the advantages of Klopfenstein tapers in GRIN lens design. The results demonstrate the usefulness of the proposed design method.


How to use Persistent Memory in your Database. Persistent or Non Volatile Memory (PMEM or NVM) has recently become commercially available under several configurations with different purposes and goals. Despite the attention to the topic, we are not aware of a comprehensive empirical analysis of existing relational database engines under different PMEM configurations. Such a study is important to understand the performance implications of the various hardware configurations and how different DB engines can benefit from them. To this end, we analyze three different engines (PostgreSQL, MySQL, and SQLServer) under common workloads (TPC C and TPC H) with all possible PMEM configurations supported by Intel's Optane NVM devices (PMEM as persistent memory in AppDirect mode and PMEM as volatile memory in Memory mode). Our results paint a complex picture and are not always intuitive due to the many factors involved. Based on our findings, we provide insights on how the different engines behave with PMEM and which configurations and queries perform best. Our results show that using PMEM as persistent storage usually speeds up query execution, but with some caveats as the I O path is not fully optimized. Additionally, using PMEM in Memory mode does not offer any performance advantage despite the larger volatile memory capacity. Through the extensive coverage of engines and parameters, we provide an important starting point for exploiting PMEM in databases and tuning relational engines to take advantage of this new technology.


Comparison of Machine Learning for Sentiment Analysis in Detecting Anxiety Based on Social Media Data. All groups of people felt the impact of the COVID 19 pandemic. This situation triggers anxiety, which is bad for everyone. The government's role is very influential in solving these problems with its work program. It also has many pros and cons that cause public anxiety. For that, it is necessary to detect anxiety to improve government programs that can increase public expectations. This study applies machine learning to detecting anxiety based on social media comments regarding government programs to deal with this pandemic. This concept will adopt a sentiment analysis in detecting anxiety based on positive and negative comments from netizens. The machine learning methods implemented include K NN, Bernoulli, Decision Tree Classifier, Support Vector Classifier, Random Forest, and XG boost. The data sample used is the result of crawling YouTube comments. The data used amounted to 4862 comments consisting of negative and positive data with 3211 and 1651. Negative data identify anxiety, while positive data identifies hope (not anxious). Machine learning is processed based on feature extraction of count vectorization and TF IDF. The results showed that the sentiment data amounted to 3889 and 973 in testing, and training with the greatest accuracy was the random forest with feature extraction of vectorization count and TF IDF of 84.99 and 82.63 , respectively. The best precision test is K NN, while the best recall is XG Boost. Thus, Random Forest is the best accurate to detect someone's anxiety based on data from social media.


Higher Hida theory for Hilbert modular varieties in the totally split case. We study p adic properties of the coherent cohomology of some automorphic sheaves on the Hilbert modular variety X for a totally real field F in the case where the prime p is totally split in F . More precisely, we develop higher Hida theory a la Pilloni, constructing, for 0 leq q leq F mathbb Q , some modules M q which p adically interpolate the ordinary part of the cohomology groups H q(X, underline omega kappa ) , varying the weight kappa of the automorphic sheaf.


Detecting Adversarial Examples by Input Transformations, Defense Perturbations, and Voting. Over the last few years, convolutional neural networks (CNNs) have proved to reach super human performance in visual recognition tasks. However, CNNs can easily be fooled by adversarial examples, i.e., maliciously crafted images that force the networks to predict an incorrect output while being extremely similar to those for which a correct output is predicted. Regular adversarial examples are not robust to input image transformations, which can then be used to detect whether an adversarial example is presented to the network. Nevertheless, it is still possible to generate adversarial examples that are robust to such transformations. This paper extensively explores the detection of adversarial examples via image transformations and proposes a novel methodology, called textit defense perturbation , to detect robust adversarial examples with the same input transformations the adversarial examples are robust to. Such a textit defense perturbation is shown to be an effective counter measure to robust adversarial examples. Furthermore, multi network adversarial examples are introduced. This kind of adversarial examples can be used to simultaneously fool multiple networks, which is critical in systems that use network redundancy, such as those based on architectures with majority voting over multiple CNNs. An extensive set of experiments based on state of the art CNNs trained on the Imagenet dataset is finally reported.


Semantically Meaningful Class Prototype Learning for One Shot Image Semantic Segmentation. One shot semantic image segmentation aims to segment the object regions for the novel class with only one annotated image. Recent works adopt the episodic training strategy to mimic the expected situation at testing time. However, these existing approaches simulate the test conditions too strictly during the training process, and thus cannot make full use of the given label information. Besides, these approaches mainly focus on the foreground background target class segmentation setting. They only utilize binary mask labels for training. In this paper, we propose to leverage the multi class label information during the episodic training. It will encourage the network to generate more semantically meaningful features for each category. After integrating the target class cues into the query features, we then propose a pyramid feature fusion module to mine the fused features for the final classifier. Furthermore, to take more advantage of the support image mask pair, we propose a self prototype guidance branch to support image segmentation. It can constrain the network for generating more compact features and a robust prototype for each semantic class. For inference, we propose a fused prototype guidance branch for the segmentation of the query image. Specifically, we leverage the prediction of the query image to extract the pseudo prototype and combine it with the initial prototype. Then we utilize the fused prototype to guide the final segmentation of the query image. Extensive experiments demonstrate the superiority of our proposed approach.


An efficient branch and cut algorithm for the parallel drone scheduling traveling salesman problem. We propose an efficient branch and cut algorithm to exactly solve the parallel drone scheduling traveling salesman problem. Our algorithm can find optimal solutions for all but two existing instances with up to 229 customers in a reasonable running time. To make the problem more challenging for future methods, we introduce two new sets of 120 larger instances with the number of customers varying from 318 to 783 and test our algorithm and investigate the performance of state of the art metaheuristics on these instances.


Estimating Community Feedback Effect on Topic Choice in Social Media with Predictive Modeling. Social media users post content on various topics. A defining feature of social media is that other users can provide feedback called community feedback to their content in the form of comments, replies, and retweets. We hypothesize that the amount of received feedback influences the choice of topics on which a social media user posts. However, it is challenging to test this hypothesis as user heterogeneity and external confounders complicate measuring the feedback effect. Here, we investigate this hypothesis with a predictive approach based on an interpretable model of an author's decision to continue the topic of their previous post. We explore the confounding factors, including author's topic preferences and unobserved external factors such as news and social events, by optimizing the predictive accuracy. This approach enables us to identify which users are susceptible to community feedback. Overall, we find that 33 and 14 of active users in Reddit and Twitter, respectively, are influenced by community feedback. The model suggests that this feedback alters the probability of topic continuation up to 14 , depending on the user and the amount of feedback.


Advanced techniques for adaptive video streaming in SDNs. This chapter briefky describes a study on software defined networks and the tools necessary for video transmission on this type of networks. Among the aspects presented is the methodology used to establish the video transmission and the procedure to evaluate the quality obtained. A video transmission experiment is presented, which consists on the evaluation of adaptive transmission of video streams using adaptive techniques as MPEG DASH and scalable coding. The experiments were carried out over a software defined network topology in the MININET Platform


Resonant response in tunable metasurface based on crossed all dielectric gratings. We theoretically demonstrate mechanical tuning of the spectral response of a Mie like resonant dielectric metasurface consisting of crossed all dielectric strip gratings. We use two array of parallel dielectric strips superimposed on each other to mechanically alter the crossing angle between them thereby changing the position of the maximum of the spectral response in a wide frequency range. The metasurface structure is considered as a doubly periodic system in an oblique mesh. This mechanically controllable metasurface can be perspective in developing of a flexible polarization sensitive optical devices.


Secure and Safety Mobile Network System for Visually Impaired People. The proposed system aims to be a techno friend of visually impaired people to assist them in orientation and mobility both indoor and outdoor. Moving through an unknown environment becomes a real challenge for most of them, although they rely on their other senses. An age old mechanism used for assistance for the blind people is a white cane commonly known as walking cane a simple and purely mechanical device to detect the ground, uneven surfaces, holes and steps using simple Tactile force feedback.


Extracting Semantics from Maintenance Records. Rapid progress in natural language processing has led to its utilization in a variety of industrial and enterprise settings, including in its use for information extraction, specifically named entity recognition and relation extraction, from documents such as engineering manuals and field maintenance reports. While named entity recognition is a well studied problem, existing state of the art approaches require large labelled datasets which are hard to acquire for sensitive data such as maintenance records. Further, industrial domain experts tend to distrust results from black box machine learning models, especially when the extracted information is used in downstream predictive maintenance analytics. We overcome these challenges by developing three approaches built on the foundation of domain expert knowledge captured in dictionaries and ontologies. We develop a syntactic and semantic rules based approach and an approach leveraging a pre trained language model, fine tuned for a question answering task on top of our base dictionary lookup to extract entities of interest from maintenance records. We also develop a preliminary ontology to represent and capture the semantics of maintenance records. Our evaluations on a real world aviation maintenance records dataset show promising results and help identify challenges specific to named entity recognition in the context of noisy industrial data.


DisenHAN Disentangled Heterogeneous Graph Attention Network for Recommendation. Heterogeneous information network has been widely used to alleviate sparsity and cold start problems in recommender systems since it can model rich context information in user item interactions. Graph neural network is able to encode this rich context information through propagation on the graph. However, existing heterogeneous graph neural networks neglect entanglement of the latent factors stemming from different aspects. Moreover, meta paths in existing approaches are simplified as connecting paths or side information between node pairs, overlooking the rich semantic information in the paths. In this paper, we propose a novel disentangled heterogeneous graph attention network DisenHAN for top N recommendation, which learns disentangled user item representations from different aspects in a heterogeneous information network. In particular, we use meta relations to decompose high order connectivity between node pairs and propose a disentangled embedding propagation layer which can iteratively identify the major aspect of meta relations. Our model aggregates corresponding aspect features from each meta relation for the target user item. With different layers of embedding propagation, DisenHAN is able to explicitly capture the collaborative filtering effect semantically. Extensive experiments on three real world datasets show that DisenHAN consistently outperforms state of the art approaches. We further demonstrate the effectiveness and interpretability of the learned disentangled representations via insightful case studies and visualization.


Logarithmic Pandharipande Thomas Spaces and the Secondary Polytope. We study Maulik and Ranganathan's definition of logarithmic stable pairs spaces for toric surfaces relative the toric boundary. We provide a simplified and canonical construction of these spaces. As a special case we construct the logarithmic linear system a toric stack whose combinatorics is related to the secondary polytope construction of Gelfand, Kapranov and Zelevinsky. We identify logarithmic stable pairs spaces with the zero set of a section of an explicit vector bundle inside a toric stack, thus providing an explicit description of their virtual fundamental class. The canonicity of our moduli space allow us to perform a number of explicit computations in logarithmic Pandharipande Thomas theory. These computations give an indication of the range of phenomena in this subject.


Uncertainty in Self Adaptive Systems A Research Community Perspective. One of the primary drivers for self adaptation is ensuring that systems achieve their goals regardless of the uncertainties they face during operation. Nevertheless, the concept of uncertainty in self adaptive systems is still insufficiently understood. Several taxonomies of uncertainty have been proposed, and a substantial body of work exists on methods to tame uncertainty. Yet, these taxonomies and methods do not fully convey the research community's perception on what constitutes uncertainty in self adaptive systems and how to tackle it. To understand this perception and learn from it, we conducted a survey comprising two complementary stages. In the first stage, we focused on current research and development. In the second stage, we focused on directions for future research. The key findings of the first stage are a) an overview of uncertainty sources considered in self adaptive systems, b) an overview of existing methods used to tackle uncertainty in concrete applications, c) insights into the impact of uncertainty on non functional requirements, d) insights into different opinions in the perception of uncertainty within the community, and the need for standardised uncertainty handling processes to facilitate uncertainty management in self adaptive systems. The key findings of the second stage are a) the insight that over 70 of the participants believe that self adaptive systems can be engineered to cope with unanticipated change, b) a set of potential approaches for dealing with unanticipated change, c) a set of open challenges in mitigating uncertainty in self adaptive systems, in particular in those with safety critical requirements. From these findings, we outline an initial reference process to manage uncertainty in self adaptive systems.


Diameter estimate for closed manifolds with positive scalar curvature. For a simply connected closed Riemannian manifold with positive scalar curvature, we prove an upper diameter bound in terms of its scalar curvature integral, the Yamabe constant and the dimension of the manifold. When a manifold has a conformal immersion into a sphere, the dependency on the Yamabe constant is not necessary. The power of scalar curvature integral in these diameter estimates is sharp and it occurs at round spheres with canonical metric.


Quantifying Reproducibility in NLP and ML. Reproducibility has become an intensely debated topic in NLP and ML over recent years, but no commonly accepted way of assessing reproducibility, let alone quantifying it, has so far emerged. The assumption has been that wider scientific reproducibility terminology and definitions are not applicable to NLP ML, with the result that many different terms and definitions have been proposed, some diametrically opposed. In this paper, we test this assumption, by taking the standard terminology and definitions from metrology and applying them directly to NLP ML. We find that we are able to straightforwardly derive a practical framework for assessing reproducibility which has the desirable property of yielding a quantified degree of reproducibility that is comparable across different reproduction studies.


Construction and comparative study of Euler method with adaptive IQ and IMQ RBFs. The fundamental purpose of the present work is to constitute an enhanced Euler method with adaptive inverse quadratic and inverse multi quadratic radial basis function (RBF) interpolation technique to solve initial value problems. These enhanced methods improve the local convergence of numerical solutions by utilizing a free parameter of radial basis functions. Consistency, convergence, and stability analysis are provided to support our claims for each method. Numerical results show that the accuracy and rate of convergence of each proposed method are the same as the original Euler method or improved by making the local truncation error vanish thus, the adaptive methods are optimal.


Apollonian Packings and Kac Moody Root Systems. We study Apollonian circle packings in relation to a certain rank 4 indefinite Kac Moody root system Phi . We introduce the generating function Z( mathbf s ) of a packing, an exponential series in four variables with an Apollonian symmetry group, which relates to Weyl Kac characters of Phi . By exploiting the presence of affine and Lorentzian hyperbolic root subsystems of Phi , with automorphic Weyl denominators, we express Z( mathbf s ) in terms of Jacobi theta functions and the Siegel modular form Delta 5 . We also show that the domain of convergence of Z( mathbf s ) is the Tits cone of Phi , and discover that this domain inherits the intricate geometric structure of Apollonian packings.


Impact of assortative mixing by mask wearing on the propagation of epidemics in networks. In this study, we discuss the impacts of assortative mixing by mask wearing on the effectiveness of mask use in suppressing the propagation of epidemics. We employ the mask model, which is an epidemic model involving mask wearers and non mask wearers. We derive the occurrence probability and mean size of large outbreaks, epidemic threshold, and average epidemic size for the mask model in an assortatively mixed random network that follows an arbitrary degree distribution. Applying our analysis to the Poisson random networks, we find that the assortative (disassortative) mixing by mask wearing decreases (increases) the epidemic threshold. In high transmissibility cases, we establish that mask use is most effective in decreasing the occurrence probability and mean size of large outbreaks, as well as the average epidemic size, when the mixing pattern is strongly assortative. In scale free networks, mask use is most effective when the mixing pattern is strongly assortative and when it is maximally disassortative, provided that the mask coverage is not low.


A note on one dimensional symmetry for Hamilton Jacobi equations with extremal Pucci operators and application to Bernstein type estimate. We prove a Liouville type theorem that is one dimensional symmetry and classification results for non negative L q viscosity solutions of the equation begin equation mathcal M lambda, Lambda pm (D 2u) pm Du p 0, x in mathbb R n, end equation with boundary condition u( tilde x ,0) M geq 0, tilde x in mathbb R n 1 , where mathcal M lambda, Lambda pm are the Pucci's operators with parameters lambda, Lambda in mathbb R 0 lambda leq Lambda and p 1 . The results are an extension of the results by Porreta and Ver 'on in arXiv 0805.2533 for the case p in (1,2 and by o Filippucci, Pucci and Souplet in arXiv 1906.05161 for the case p 2 , both for the Laplacian case (i.e. lambda Lambda 1 ). As an application in the case p 2 , we prove a sharp Bernstein estimation for L q viscosity solutions of the fully nonlinear equation begin equation mathcal M lambda, Lambda pm (D 2u) Du p f(x), quad x in Omega, label ecuacion1 end equation with boundary condition u 0 on partial Omega , where Omega subset mathbb R n .


Transparent Checkpointing for OpenGL Applications on GPUs. This work presents transparent checkpointing of OpenGL applications, refining the split process technique 1 for application in GPU based 3D graphics. The split process technique was earlier applied to checkpointing MPI and CUDA programs, enabling reinitialization of driver libraries. The presented design targets practical, checkpoint package agnostic checkpointing of OpenGL applications. An early prototype is demonstrated on Autodesk Maya. Maya is a complex proprietary media creation software suite used with large scale rendering hardware for CGI (Computer Generated Animation). Transparent checkpointing of Maya provides critically needed fault tolerance, since Maya is prone to crash when artists use some of its bleeding edge components. Artists then lose hours of work in re creating their complex environment.


A Unified Survey on Anomaly, Novelty, Open Set, and Out of Distribution Detection Solutions and Future Challenges. Machine learning models often encounter samples that are diverged from the training distribution. Failure to recognize an out of distribution (OOD) sample, and consequently assign that sample to an in class label significantly compromises the reliability of a model. The problem has gained significant attention due to its importance for safety deploying models in open world settings. Detecting OOD samples is challenging due to the intractability of modeling all possible unknown distributions. To date, several research domains tackle the problem of detecting unfamiliar samples, including anomaly detection, novelty detection, one class learning, open set recognition, and out of distribution detection. Despite having similar and shared concepts, out of distribution, open set, and anomaly detection have been investigated independently. Accordingly, these research avenues have not cross pollinated, creating research barriers. While some surveys intend to provide an overview of these approaches, they seem to only focus on a specific domain without examining the relationship between different domains. This survey aims to provide a cross domain and comprehensive review of numerous eminent works in respective areas while identifying their commonalities. Researchers can benefit from the overview of research advances in different fields and develop future methodology synergistically. Furthermore, to the best of our knowledge, while there are surveys in anomaly detection or one class learning, there is no comprehensive or up to date survey on out of distribution detection, which our survey covers extensively. Finally, having a unified cross domain perspective, we discuss and shed light on future lines of research, intending to bring these fields closer together.


The algebraic and geometric classification of nilpotent left symmetric algebras. This paper is devoted to the complete algebraic and geometric classification of complex 4 dimensional nilpotent left symmetric algebras. The corresponding geometric variety has dimension 15 and decomposes into 3 irreducible components determined by the Zariski closures of two one parameter families of algebras and a two parameter family of algebras (see Theorem B). In particular, there are no rigid 4 dimensional complex nilpotent left symmetric algebras.


Occupancy Detection in Room Using Sensor Data. With the advent of Internet of Thing (IoT), and ubiquitous data collected every moment by either portable (smart phone) or fixed (sensor) devices, it is important to gain insights and meaningful information from the sensor data in context aware computing environments. Many researches have been implemented by scientists in different fields, to analyze such data for the purpose of security, energy efficiency, building reliability and smart environments. One study, that many researchers are interested in, is to utilize Machine Learning techniques for occupancy detection where the aforementioned sensors gather information about the environment. This paper provides a solution to detect occupancy using sensor data by using and testing several variables. Additionally we show the analysis performed over the gathered data using Machine Learning and pattern recognition mechanisms is possible to determine the occupancy of indoor environments. Seven famous algorithms in Machine Learning, namely as Decision Tree, Random Forest, Gradient Boosting Machine, Logistic Regression, Naive Bayes, Kernelized SVM and K Nearest Neighbors are tested and compared in this study.


Variable Division and Optimization for Constrained Multiobjective Portfolio Problems. Variable division and optimization (D O) is a frequently utilized algorithm design paradigm in Evolutionary Algorithms (EAs). A D O EA divides a variable into partial variables and then optimize them respectively. A complicated problem is thus divided into simple subtasks. For example, a variable of portfolio problem can be divided into two partial variables, i.e. the selection of assets and the allocation of capital. Thereby, we optimize these two partial variables respectively. There is no formal discussion about how are the partial variables iteratively optimized and why can it work for both single and multi objective problems in D O. In this paper, this gap is filled. According to the discussion, an elitist selection method for partial variables in multiobjective problems is developed. Then this method is incorporated into the Decomposition Based Multiobjective Evolutionary Algorithm (D O MOEA D). With the help of a mathematical programming optimizer, it is achieved on the constrained multiobjective portfolio problems. In the empirical study, D O MOEA D is implemented for 20 instances and recent Chinese stock markets. The results show the superiority and versatility of D O MOEA D on large scale instances while the performance of it on small scale problems is also not bad. The former targets convergence towards the Pareto front and the latter helps promote diversity among the non dominated solutions during the search process.


Teacher's pet understanding and mitigating biases in distillation. Knowledge distillation is widely used as a means of improving the performance of a relatively simple student model using the predictions from a complex teacher model. Several works have shown that distillation significantly boosts the student's overall performance however, are these gains uniform across all data subgroups? In this paper, we show that distillation can harm performance on certain subgroups, e.g., classes with few associated samples. We trace this behaviour to errors made by the teacher distribution being transferred to and amplified by the student model. To mitigate this problem, we present techniques which soften the teacher influence for subgroups where it is less reliable. Experiments on several image classification benchmarks show that these modifications of distillation maintain boost in overall accuracy, while additionally ensuring improvement in subgroup performance.


Existence of physical measures in some Excitation Inhibition Networks. In this paper we present a rigorous analysis of a class of coupled dynamical systems in which two distinct types of components, one excitatory and the other inhibitory, interact with one another. These network models are finite in size but can be arbitrarily large. They are inspired by real biological networks, and possess features that are idealizations of those in biological systems. Individual components of the network are represented by simple, much studied dynamical systems. Complex dynamical patterns on the network level emerge as a result of the coupling among its constituent subsystems. Appealing to existing techniques in (nonuniform) hyperbolic theory, we study their Lyapunov exponents and entropy, and prove that large time network dynamics are governed by physical measures with the SRB property.


General Inverse Design of Thin Film Metamaterials With Convolutional Neural Networks. The design of metamaterials which support unique optical responses is the basis for most thin film nanophotonics applications. In practice this inverse design problem can be difficult to solve systematically due to the large design parameter space associated with general multi layered systems. We apply convolutional neural networks, a subset of deep machine learning, as a tool to solve this inverse design problem for metamaterials composed of stacks of thin films. We demonstrate the remarkable ability of neural networks to probe the large global design space (up to 10 12 possible parameter combinations) and resolve all relationships between metamaterial structure and corresponding ellipsometric and reflectance transmittance spectra. The applicability of the approach is further expanded to include the inverse design of synthetic engineered spectra in general design scenarios. Furthermore, this approach is compared with traditional optimization methods. We find an increase in the relative optimization efficiency of the networks with increasing total layer number, revealing the advantage of the machine learning approach in many layered systems where traditional methods become impractical.


Use of Transfer Learning and Wavelet Transform for Breast Cancer Detection. Breast cancer is one of the most common cause of deaths among women. Mammography is a widely used imaging modality that can be used for cancer detection in its early stages. Deep learning is widely used for the detection of cancerous masses in the images obtained via mammography. The need to improve accuracy remains constant due to the sensitive nature of the datasets so we introduce segmentation and wavelet transform to enhance the important features in the image scans. Our proposed system aids the radiologist in the screening phase of cancer detection by using a combination of segmentation and wavelet transforms as pre processing augmentation that leads to transfer learning in neural networks. The proposed system with these pre processing techniques significantly increases the accuracy of detection on Mini MIAS.


Non orderability of random triangular groups by using random 3CNF formulas. We show that a random group Gamma in the triangular binomial model Gamma(n, p) is a.a.s. not left orderable for p in(cn 2 , n 3 2 varepsilon ) , where c, varepsilon are any constants satisfying varepsilon 0 , c (1 8) log 4 3 2 approx 0.3012 . We also prove that if p geq (1 varepsilon)( log n)n 2 for any fixed varepsilon 0 , then a random Gamma in Gamma(n,p) has a.a.s. no non trivial left orderable quotients. We proceed by constructing 3CNF formulas, which encode necessary conditions for left orderability and then proving their unsatisfiability a.a.s.


One Dimensional Fragment over Words and Trees. One dimensional fragment of first order logic is obtained by restricting quantification to blocks of existential (universal) quantifiers that leave at most one variable free. We investigate this fragment over words and trees, presenting a complete classification of the complexity of its satisfiability problem for various navigational signatures, and comparing its expressive power with other important formalisms. These include the two variable fragment with counting and the unary negation fragment.


Filtered simplicial homology, graph dissimilarity and " u berhomology. We introduce a natural filtration on the simplicial homology of a finite simplicial complex X using bi colourings of its vertices. This yields two dual homology theories, which generalise simplicial homology and are closely related to discrete Morse matchings on X . We give an explicit expression for the associated graded object of these homologies when X is the matching complex of the Tait graph of a plane graph G , in terms of subgraphs determined by certain matchings on the dual of G . We then use one of these homologies, in the case where X is a graph, to define a conjecturally optimal dissimilarity pseudometric for graphs we prove various results for this dissimilarity and provide several computations. We further show that, by organising the horizontal homologies of a simplicial complex in the poset of its colourings, we obtain a triply graded homology theory which we call "uberhomology. This latter homology is not a homotopy invariant, but nonetheless encodes both combinatorial and topological information on X . For example we prove that if X is a subdivision, the "uberhomology vanishes in its lowest degree, while for an homology manifold it coincides with the fundamental class in its top degree. We compute the "uberhomology on several classes of examples and infinite families, and prove some of its properties namely that, in its extremal degrees, it is well behaved under coning and taking suspension. We then focus on the case where X is a simple graph, and prove a detection result. Finally, we define some singly graded homologies for graphs obtained by specialising the "uberhomology in certain bi degrees, provide some computations and use computer aided calculations to make some conjectures.


Binary trees using the bookshelf and baseball constructions. This is a largely expository paper in which we discuss various sets having a Catalan number of objects and some well known bijections between these sets presented in a new and hopefully interesting way. We call these concepts "bookshelf" and "baseball" constructions. No knowledge of these topics is assumed. These are the final student papers for a course at Brandeis University.


A Strong Baseline for Query Efficient Attacks in a Black Box Setting. Existing black box search methods have achieved high success rate in generating adversarial attacks against NLP models. However, such search methods are inefficient as they do not consider the amount of queries required to generate adversarial attacks. Also, prior attacks do not maintain a consistent search space while comparing different search methods. In this paper, we propose a query efficient attack strategy to generate plausible adversarial examples on text classification and entailment tasks. Our attack jointly leverages attention mechanism and locality sensitive hashing (LSH) to reduce the query count. We demonstrate the efficacy of our approach by comparing our attack with four baselines across three different search spaces. Further, we benchmark our results across the same search space used in prior attacks. In comparison to attacks proposed, on an average, we are able to reduce the query count by 75 across all datasets and target models. We also demonstrate that our attack achieves a higher success rate when compared to prior attacks in a limited query setting.


A discrete complement of Lyapunov's inequality and its information theoretic consequences. We establish a reversal of Lyapunov's inequality for monotone log concave sequences, settling a conjecture of Havrilla Tkocz and Melbourne Tkocz. A strengthened version of the same conjecture is disproved through counter example. We also derive several information theoretic inequalities as consequences. In particular sharp bounds are derived for the varentropy, R 'enyi entropies, and the concentration of information of monotone log concave random variables. Moreover, the majorization approach utilized in the proof of the main theorem, is applied to derive analogous information theoretic results in the symmetric setting, where the Lyapunov reversal is known to fail.


A Central Limit Theorem for Linear Combinations of Logarithms of Dirichlet L functions. The purpose of this paper is to generalize our earlier work on the logarithm of the Riemann zeta function to linear combinations of logarithms of primitive Dirichlet L functions with constant real coefficients. Under the assumption of suitable hypotheses, we prove that as T to infty , a sequence of the form (a 1 log L( rho, chi n) dots a 1 log L( rho, chi n) ) has an approximate Gaussian distribution with mean 0 and variance tfrac 1 2 big( a 1 2 dots a n 2 big) log log T . Here a 1, dots, a n in mathbb R , each of the chi i is a primitive Dirichlet character modulo M i with M i leq T , and 0 operatorname Im rho leq T where rho runs over nontrivial zeros of the zeta function. From the proof of this result, we also derive the independence of the distributions of sequences ( log L( rho, chi 1) ), dots, ( log L( rho, chi n) ) provided that they are suitably normalized.


Could mass eccentricity explain the formation of orbits in wind turbines?. The kinematics of offshore wind turbines are of great importance when installing the turbines, as the motions of the components during craning operations are a limiting factor. Most critical is the installation of the blades the blade's bolts need to be inserted into the rotor flange, an operation that requires great precision. Both the blade and the turbine undergo environmental loading, leading to relative motions between the blade root and the hub during installation. Results from an offshore wind farm installation measurement campaign showed, that the partially installed turbines show intricate patterns of motion (orbits) in the horizontal plane. The mechanism behind the formation of these orbits remains elusive so far. In this paper, we present a novel torsional coupling mechanism linking motions in the fore aft and side side direction. It can explain the formation of orbits that change direction.


First Order Differential Equations Induced by the Infinite Servers Queue with Poisson Arrivals Transient Behavior Probability Distribution Parameters Study as Time Functions. The infinite servers queue with Poisson arrivals state transient probabilities, considering the time origin at the beginning of a busy period, mean and variance monotony as time functions is studied. These studies, for which results it is determinant the hazard rate function service time length, induce the consideration of two differential equations, one related with the mean monotony study and another with the variance monotony study, which solutions lead to some particular service time distributions, for which those parameters present specific behaviors as time functions.


Probing Language Models for Understanding of Temporal Expressions. We present three Natural Language Inference (NLI) challenge sets that can evaluate NLI models on their understanding of temporal expressions. More specifically, we probe these models for three temporal properties (a) the order between points in time, (b) the duration between two points in time, (c) the relation between the magnitude of times specified in different units. We find that although large language models fine tuned on MNLI have some basic perception of the order between points in time, at large, these models do not have a thorough understanding of the relation between temporal expressions.


Mobilkit A Python Toolkit for Urban Resilience and Disaster Risk Management Analytics using High Frequency Human Mobility Data. Increasingly available high frequency location datasets derived from smartphones provide unprecedented insight into trajectories of human mobility. These datasets can play a significant and growing role in informing preparedness and response to natural disasters. However, limited tools exist to enable rapid analytics using mobility data, and tend not to be tailored specifically for disaster risk management. We present an open source, Python based toolkit designed to conduct replicable and scalable post disaster analytics using GPS location data. Privacy, system capabilities, and potential expansions of textit Mobilkit are discussed.


Prevention and Resolution of Conflicts in Social Navigation a Survey. With the approaching goal of having robots collaborate in shared human robot environments, navigation in this context becomes both crucial and desirable. Recent developments in robotics have encountered and tackled some of the challenges of navigating in mixed human robot environments, and in recent years we observe a surge of related work that specifically targets the question of how to handle conflicts between agents in social navigation. These contributions offer models, algorithms, and evaluation metrics, however as this research area is inherently interdisciplinary, many of the relevant papers are not comparable and there is no standard vocabulary between the researchers. The main goal of this survey is to bridge this gap by proposing such a common language, using it to survey existing work, and highlighting open problems. It starts by defining a conflict in social navigation, and offers a detailed taxonomy of its components. This survey then maps existing work while discussing papers using the framing of the proposed taxonomy. Finally, this paper propose some future directions and problems that are currently in the frontier of social navigation to help focus research efforts.


A Remarkable Summation Formula, Lattice Tilings, and Fluctuations. We derive and prove an explicit formula for the sum of the fractional parts of certain geometric series. Although the proof is straightforward, we have been unable to locate any reference to this result. This summation formula allows us to efficiently analyze the average behavior of certain common nonlinear dynamical systems, such as the angle doubling map, x mapsto 2x modulo 1. In particular, one can use this information to analyze how the behavior of individual orbits deviates from the global average (called fluctuations). More generally, the formula is valid in mathbb R m , where expanding maps give rise to so called number systems. To illustrate the usefulness in this setting, we compute the fluctuations of a certain map on the plane.


Learners' languages. In "Backprop as functor", the authors show that the fundamental elements of deep learning gradient descent and backpropagation can be conceptualized as a strong monoidal functor mathbf Para ( mathbf Euc ) to mathbf Learn from the category of parameterized Euclidean spaces to that of learners, a category developed explicitly to capture parameter update and backpropagation. It was soon realized that there is an isomorphism mathbf Learn cong mathbf Para ( mathbf SLens ) , where mathbf SLens is the symmetric monoidal category of simple lenses as used in functional programming. In this note, we observe that mathbf SLens is a full subcategory of mathbf Poly , the category of polynomial functors in one variable, via the functor A mapsto Ay A . Using the fact that ( mathbf Poly , otimes) is monoidal closed, we show that a map A to B in mathbf Para ( mathbf SLens ) has a natural interpretation in terms of dynamical systems (more precisely, generalized Moore machines) whose interface is the internal hom type Ay A,By B . Finally, we review the fact that the category p text mathbf Coalg of dynamical systems on any p in mathbf Poly forms a topos, and consider the logical propositions that can be stated in its internal language. We give gradient descent as an example, and we conclude by discussing some directions for future work.


Robust Learning Meets Generative Models Can Proxy Distributions Improve Adversarial Robustness?. While additional training data improves the robustness of deep neural networks against adversarial examples, it presents the challenge of curating a large number of specific real world samples. We circumvent this challenge by using additional data from proxy distributions learned by advanced generative models. We first seek to formally understand the transfer of robustness from classifiers trained on proxy distributions to the real data distribution. We prove that the difference between the robustness of a classifier on the two distributions is upper bounded by the conditional Wasserstein distance between them. Next we use proxy distributions to significantly improve the performance of adversarial training on five different datasets. For example, we improve robust accuracy by up to 7.5 and 6.7 in ell infty and ell 2 threat model over baselines that are not using proxy distributions on the CIFAR 10 dataset. We also improve certified robust accuracy by 7.6 on the CIFAR 10 dataset. We further demonstrate that different generative models bring a disparate improvement in the performance in robust training. We propose a robust discrimination approach to characterize the impact of individual generative models and further provide a deeper understanding of why current state of the art in diffusion based generative models are a better choice for proxy distribution than generative adversarial networks.


Asymptotics of Sharp Constants in Markov Bernstein Nikolskii type Inequalities with Exponential Weights. We prove that the sharp constant in the univariate Bernstein Nikolskii inequality for entire functions of exponential type is the limit of the sharp constant in the V. A. Markov type inequality with an exponential weight for coefficients of an algebraic polynomials of degree n as n to iy .


A View of Regularized Approaches for Image Segmentation. Image segmentation is a central topic in image processing and computer vision and a key issue in many applications, e.g., in medical imaging, microscopy, document analysis and remote sensing. According to the human perception, image segmentation is the process of dividing an image into non overlapping regions. These regions, which may correspond, e.g., to different objects, are fundamental for the correct interpretation and classification of the scene represented by the image. The division into regions is not unique, but it depends on the application, i.e., it must be driven by the final goal of the segmentation and hence by the most significant features with respect to that goal. Image segmentation can be regarded as an ill posed problem. A classical approach to deal with ill posedness consists in the use of regularization, which allows us to incorporate in the model a priori information about the solution. In this work we provide a brief overview of regularized mathematical models for image segmentation, considering edge based and region based variational models, as well as statistical and machine learning approaches. We also sketch numerical methods that are applied in computing solutions of those models. In our opinion, a unifying view of regularized mathematical models and related computational tools for segmentation can help the readers identify the most appropriate methods for solving their specific segmentation problems. It can also provide a basis for designing new methods combining existing ones.


Learning with Neural Tangent Kernels in Near Input Sparsity Time. The Neural Tangent Kernel (NTK) characterizes the behavior of infinitely wide neural nets trained under least squares loss by gradient descent. However, despite its importance, the super quadratic runtime of kernel methods limits the use of NTK in large scale learning tasks. To accelerate kernel machines with NTK, we propose a near input sparsity time algorithm that maps the input data to a randomized low dimensional feature space so that the inner product of the transformed data approximates their NTK evaluation. Our transformation works by sketching the polynomial expansions of arc cosine kernels. Furthermore, we propose a feature map for approximating the convolutional counterpart of the NTK, which can transform any image using a runtime that is only linear in the number of pixels. We show that in standard large scale regression and classification tasks a linear regressor trained on our features outperforms trained Neural Nets and Nystrom approximation of NTK kernel.


TWAG A Topic Guided Wikipedia Abstract Generator. Wikipedia abstract generation aims to distill a Wikipedia abstract from web sources and has met significant success by adopting multi document summarization techniques. However, previous works generally view the abstract as plain text, ignoring the fact that it is a description of a certain entity and can be decomposed into different topics. In this paper, we propose a two stage model TWAG that guides the abstract generation with topical information. First, we detect the topic of each input paragraph with a classifier trained on existing Wikipedia articles to divide input documents into different topics. Then, we predict the topic distribution of each abstract sentence, and decode the sentence from topic aware representations with a Pointer Generator network. We evaluate our model on the WikiCatSum dataset, and the results show that modelnames outperforms various existing baselines and is capable of generating comprehensive abstracts. Our code and dataset can be accessed at url https github.com THU KEG TWAG


Faster Algorithms for Longest Common Substring. In the classic longest common substring (LCS) problem, we are given two strings S and T , each of length at most n , over an alphabet of size sigma , and we are asked to find a longest string occurring as a fragment of both S and T . Weiner, in his seminal paper that introduced the suffix tree, presented an mathcal O (n log sigma) time algorithm for this problem SWAT 1973 . For polynomially bounded integer alphabets, the linear time construction of suffix trees by Farach yielded an mathcal O (n) time algorithm for the LCS problem FOCS 1997 . However, for small alphabets, this is not necessarily optimal for the LCS problem in the word RAM model of computation, in which the strings can be stored in mathcal O (n log sigma log n ) space and read in mathcal O (n log sigma log n ) time. We show that, in this model, we can compute an LCS in time mathcal O (n log sigma sqrt log n ) , which is sublinear in n if sigma 2 o( sqrt log n ) (in particular, if sigma mathcal O (1) ), using optimal space mathcal O (n log sigma log n) . We then lift our ideas to the problem of computing a k mismatch LCS, which has received considerable attention in recent years. In this problem, the aim is to compute a longest substring of S that occurs in T with at most k mismatches. Thankachan et al. showed how to compute a k mismatch LCS in mathcal O (n log k n) time for k mathcal O (1) J. Comput. Biol. 2016 . We show an mathcal O (n log k 1 2 n) time algorithm, for any constant k 0 and irrespective of the alphabet size, using mathcal O (n) space as the previous approaches. We thus notably break through the well known n log k n barrier, which stems from a recursive heavy path decomposition technique that was first introduced in the seminal paper of Cole et al. STOC 2004 for string indexing with k errors.


Pythagorean Harmonic Summability of Fourier Series. The paper explores the possibility for summing Fourier series nonlinearly via the Pythagorean harmonic mean. It reports on new results for this summability with introduction of new concepts like the smoothing operator and semi harmonic summation. The smoothing operator is demonstrated to be Kalman filtering for linear summability, logistic processing for Pythagorean harmonic summability and linearized logistic processing for semi harmonic summability. An emerging direct inapplicability of harmonic summability to seismic like signals is shown to be resolvable by means of a regularizational asymptotic approach.


AirWare Utilizing Embedded Audio and Infrared Signals for In Air Hand Gesture Recognition. We introduce AirWare, an in air hand gesture recognition system that uses the already embedded speaker and microphone in most electronic devices, together with embedded infrared proximity sensors. Gestures identified by AirWare are performed in the air above a touchscreen or a mobile phone. AirWare utilizes convolutional neural networks to classify a large vocabulary of hand gestures using multi modal audio Doppler signatures and infrared (IR) sensor information. As opposed to other systems which use high frequency Doppler radars or depth cameras to uniquely identify in air gestures, AirWare does not require any external sensors. In our analysis, we use openly available APIs to interface with the Samsung Galaxy S5 audio and proximity sensors for data collection. We find that AirWare is not reliable enough for a deployable interaction system when trying to classify a gesture set of 21 gestures, with an average true positive rate of only 50.5 per gesture. To improve performance, we train AirWare to identify subsets of the 21 gestures vocabulary based on possible usage scenarios. We find that AirWare can identify three gesture sets with average true positive rate greater than 80 using 4 7 gestures per set, which comprises a vocabulary of 16 unique in air gestures.


The relationship between axial resolution and signal to noise ratio in optical coherence tomography. In optical coherence tomography (OCT), axial resolution and signal to noise ratio (SNR) are typically viewed as uncoupled parameters. We show that this is only true for mirror like surfaces, and that in diffuse scattering samples such as tissue there is an inherent coupling between axial resolution and measurement SNR. We explain the origin of this coupling and demonstrate that it can be used to achieve increased imaging penetration depth at the expense of resolution. Finally, we argue that this coupling should be considered during OCT system design processes that seek to balance competing needs of resolution, sensitivity, and system source complexity.


A Parallel in Time Preconditioner for the Schur Complement of Parabolic Optimal Control Problems. For optimal control problems constrained by a initial valued parabolic PDE, we have to solve a large scale saddle point algebraic system consisting of considering the discrete space and time points all together. A popular strategy to handle such a system is the Krylov subspace method, for which an efficient preconditioner plays a crucial role. The matching Schur complement preconditioner has been extensively studied in literature and the implementation of this preconditioner lies in solving the underlying PDEs twice, sequentially in time. In this paper, we propose a new preconditioner for the Schur complement, which can be used parallel in time (PinT) via the so called diagonalization technique. We show that the eigenvalues of the preconditioned matrix are low and upper bounded by positive constants independent of matrix size and the regularization parameter. The uniform boundedness of the eigenvalues leads to an optimal linear convergence rate of conjugate gradient solver for the preconditioned Schur complement system. To the best of our knowledge, it is the first time to have an optimal convergence analysis for a PinT preconditioning technique of the optimal control problem. Numerical results are reported to show that the performance of the proposed preconditioner is robust with respect to the discretization step sizes and the regularization parameter.


Mean Shift for Self Supervised Learning. Most recent self supervised learning (SSL) algorithms learn features by contrasting between instances of images or by clustering the images and then contrasting between the image clusters. We introduce a simple mean shift algorithm that learns representations by grouping images together without contrasting between them or adopting much of prior on the structure of the clusters. We simply "shift" the embedding of each image to be close to the "mean" of its neighbors. Since in our setting, the closest neighbor is always another augmentation of the same image, our model will be identical to BYOL when using only one nearest neighbor instead of 5 as used in our experiments. Our model achieves 72.4 on ImageNet linear evaluation with ResNet50 at 200 epochs outperforming BYOL. Our code is available here https github.com UMBCvision MSF


Data aided Sensing where Communication and Sensing Meet An Introduction. Since there are a number of Internet of Things (IoT) applications that need to collect data sets from a large number of sensors or devices in real time, sensing and communication need to be integrated for efficient uploading from devices. In this paper, we introduce the notion of data aided sensing (DAS) where a base station (BS) utilizes a subset of data that is already uploaded and available to select the next device for efficient data collection or sensing. Thus, using DAS, certain tasks in IoT applications, including federated learning, can be completed by uploading from a small number of selected devices. Two different types of DAS are considered one is centralized DAS and the other is distributed DAS. In centralized DAS, the BS decides the uploading order, while each device can decide when to upload its own local data set among multiple uploading rounds in distributed DAS. In distributed DAS, random access is employed where the access probability of each device is decided according to its local measurement for efficient uploading.


Eigenvalue embedding problem for quadratic regular matrix polynomials with symmetry structures. In this paper, we propose a unified approach for solving structure preserving eigenvalue embedding problem (SEEP) for quadratic regular matrix polynomials with symmetry structures. First, we determine perturbations of a quadratic matrix polynomial, unstructured or structured, such that the perturbed polynomials reproduce a desired invariant pair while maintaining the invariance of another invariant pair of the unperturbed polynomial. If the latter is unknown, it is referred to as no spillover perturbation. Then we use these results for solving the SEEP for structured quadratic matrix polynomials that include symmetric, Hermitian, star even and star odd quadratic matrix polynomials. Finally, we show that the obtained analytical expressions of perturbations can realize existing results for structured polynomials that arise in real world applications, as special cases. The obtained results are supported with numerical examples.


Scientia Potentia Est On the Role of Knowledge in Computational Argumentation. Despite extensive research efforts in the recent years, computational modeling of argumentation remains one of the most challenging areas of natural language processing (NLP). This is primarily due to inherent complexity of the cognitive processes behind human argumentation, which commonly combine and integrate plethora of different types of knowledge, requiring from computational models capabilities that are far beyond what is needed for most other (i.e., simpler) natural language understanding tasks. The existing large body of work on mining, assessing, generating, and reasoning over arguments largely acknowledges that much more common sense and world knowledge needs to be integrated into computational models that would accurately model argumentation. A systematic overview and organization of the types of knowledge introduced in existing models of computational argumentation (CA) is, however, missing and this hinders targeted progress in the field. In this survey paper, we fill this gap by (1) proposing a pyramid of types of knowledge required in CA tasks, (2) analysing the state of the art with respect to the reliance and exploitation of these types of knowledge, for each of the for main research areas in CA, and (3) outlining and discussing directions for future research efforts in CA.


Obstacle Avoidance for UAS in Continuous Action Space Using Deep Reinforcement Learning. Obstacle avoidance for small unmanned aircraft is vital for the safety of future urban air mobility (UAM) and Unmanned Aircraft System (UAS) Traffic Management (UTM). There are many techniques for real time robust drone guidance, but many of them solve in discretized airspace and control, which would require an additional path smoothing step to provide flexible commands for UAS. To provide a safe and efficient computational guidance of operations for unmanned aircraft, we explore the use of a deep reinforcement learning algorithm based on Proximal Policy Optimization (PPO) to guide autonomous UAS to their destinations while avoiding obstacles through continuous control. The proposed scenario state representation and reward function can map the continuous state space to continuous control for both heading angle and speed. To verify the performance of the proposed learning framework, we conducted numerical experiments with static and moving obstacles. Uncertainties associated with the environments and safety operation bounds are investigated in detail. Results show that the proposed model can provide accurate and robust guidance and resolve conflict with a success rate of over 99 .


Deep Two View Structure from Motion Revisited. Two view structure from motion (SfM) is the cornerstone of 3D reconstruction and visual SLAM. Existing deep learning based approaches formulate the problem by either recovering absolute pose scales from two consecutive frames or predicting a depth map from a single image, both of which are ill posed problems. In contrast, we propose to revisit the problem of deep two view SfM by leveraging the well posedness of the classic pipeline. Our method consists of 1) an optical flow estimation network that predicts dense correspondences between two frames 2) a normalized pose estimation module that computes relative camera poses from the 2D optical flow correspondences, and 3) a scale invariant depth estimation network that leverages epipolar geometry to reduce the search space, refine the dense correspondences, and estimate relative depth maps. Extensive experiments show that our method outperforms all state of the art two view SfM methods by a clear margin on KITTI depth, KITTI VO, MVS, Scenes11, and SUN3D datasets in both relative pose and depth estimation.


A Johnson Lindenstrauss Framework for Randomly Initialized CNNs. How does the geometric representation of a dataset change after the application of each randomly initialized layer of a neural network? The celebrated Johnson Lindenstrauss lemma answers this question for linear fully connected neural networks (FNNs), stating that the geometry is essentially preserved. For FNNs with the ReLU activation, the angle between two inputs contracts according to a known mapping. The question for non linear convolutional neural networks (CNNs) becomes much more intricate. To answer this question, we introduce a geometric framework. For linear CNNs, we show that the Johnson Lindenstrauss lemma continues to hold, namely, that the angle between two inputs is preserved. For CNNs with ReLU activation, on the other hand, the behavior is richer The angle between the outputs contracts, where the level of contraction depends on the nature of the inputs. In particular, after one layer, the geometry of natural images is essentially preserved, whereas for Gaussian correlated inputs, CNNs exhibit the same contracting behavior as FNNs with ReLU activation.


Formational bounds of link prediction in collaboration networks. Link prediction in collaboration networks is often solved by identifying structural properties of existing nodes that are disconnected at one point in time, and that share a link later on. The maximally possible recall rate or upper bound of this approach's success is capped by the proportion of links that are formed among existing nodes embedded in these properties. Consequentially, sustained ties as well as links that involve one or two new network participants are typically not predicted. The purpose of this study is to highlight formational constraints that need to be considered to increase the practical value of link prediction methods for collaboration networks. In this study, we identify the distribution of basic link formation types based on four large scale, over time collaboration networks, showing that current link predictors can maximally anticipate around 25 of links that involve at least one prior network member. This implies that for collaboration networks, increasing the accuracy of computational link prediction solutions may not be a reasonable goal when the ratio of collaboration ties that are eligible to the classic link prediction process is low.


Homological properties of extensions of abstract and pseudocompact algebras. We consider a class of extensions of both abstract and pseudocompact algebras, which we refer to as "strongly proj bounded extensions". We prove that the finiteness of the left global dimension and the support of the Hochschild homology is preserved by strongly proj bounded extensions, generalizing results of Cibils, Lanzillota, Marcos and Solotar. Moreover, we show that the finiteness of the big left finitistic dimension is preserved by strongly proj bounded extensions. In order to construct examples, we describe a new class of extensions of algebras of finite relative global dimension, which may be of independent interest.


Indoor Group Activity Recognition using Multi Layered HMMs. Discovery and recognition of Group Activities (GA) based on imagery data processing have significant applications in persistent surveillance systems, which play an important role in some Internet services. The process is involved with analysis of sequential imagery data with spatiotemporal associations. Discretion of video imagery requires a proper inference system capable of discriminating and differentiating cohesive observations and interlinking them to known ontologies. We propose an Ontology based GAR with a proper inference model that is capable of identifying and classifying a sequence of events in group activities. A multi layered Hidden Markov Model (HMM) is proposed to recognize different levels of abstract GA. The multi layered HMM consists of N layers of HMMs where each layer comprises of M number of HMMs running in parallel. The number of layers depends on the order of information to be extracted. At each layer, by matching and correlating attributes of detected group events, the model attempts to associate sensory observations to known ontology perceptions. This paper demonstrates and compares performance of three different implementation of HMM, namely, concatenated N HMM, cascaded C HMM and hybrid H HMM for building effective multi layered HMM.


Representing Inferences and their Lexicalization. We have recently begun a project to develop a more effective and efficient way to marshal inferences from background knowledge to facilitate deep natural language understanding. The meaning of a word is taken to be the entities, predications, presuppositions, and potential inferences that it adds to an ongoing situation. As words compose, the minimal model in the situation evolves to limit and direct inference. At this point we have developed our computational architecture and implemented it on real text. Our focus has been on proving the feasibility of our design.


How much pretraining data do language models need to learn syntax?. Transformers based pretrained language models achieve outstanding results in many well known NLU benchmarks. However, while pretraining methods are very convenient, they are expensive in terms of time and resources. This calls for a study of the impact of pretraining data size on the knowledge of the models. We explore this impact on the syntactic capabilities of RoBERTa, using models trained on incremental sizes of raw text data. First, we use syntactic structural probes to determine whether models pretrained on more data encode a higher amount of syntactic information. Second, we perform a targeted syntactic evaluation to analyze the impact of pretraining data size on the syntactic generalization performance of the models. Third, we compare the performance of the different models on three downstream applications part of speech tagging, dependency parsing and paraphrase identification. We complement our study with an analysis of the cost benefit trade off of training such models. Our experiments show that while models pretrained on more data encode more syntactic knowledge and perform better on downstream applications, they do not always offer a better performance across the different syntactic phenomena and come at a higher financial and environmental cost.