On an optimal quadrature formula for approximation of Fourier integrals in the space W 2 (1,0) . The present paper is devoted to construction of an optimal quadrature formula for approximation of Fourier integrals in the Hilbert space W 2 (1,0) a,b of non periodic, complex valued functions. Here the quadrature sum consists of linear combination of the given function values on uniform grid. The difference between integral and quadrature sum is estimated by the norm of the error functional. The optimal quadrature formula is obtained by minimizing the norm of the error functional with respect to coefficients. In addition, analytic formulas for optimal coefficients are obtained using the discrete analogue of the differential operator d 2 d x 2 1 . Further, the order of convergence of the optimal quadrature formula is studied.


R 'esum 'e Driven Development A Definition and Empirical Characterization. Technologies play an important role in the hiring process for software professionals. Within this process, several studies revealed misconceptions and bad practices which lead to suboptimal recruitment experiences. In the same context, grey literature anecdotally coined the term R 'esum 'e Driven Development (RDD), a phenomenon describing the overemphasis of trending technologies in both job offerings and resumes as an interaction between employers and applicants. While RDD has been sporadically mentioned in books and online discussions, there are so far no scientific studies on the topic, despite its potential negative consequences. We therefore empirically investigated this phenomenon by surveying 591 software professionals in both hiring (130) and technical (558) roles and identified RDD facets in substantial parts of our sample 60 of our hiring professionals agreed that trends influence their job offerings, while 82 of our software professionals believed that using trending technologies in their daily work makes them more attractive for prospective employers. Grounded in the survey results, we conceptualize a theory to frame and explain R 'esum 'e Driven Development. Finally, we discuss influencing factors and consequences and propose a definition of the term. Our contribution provides a foundation for future research and raises awareness for a potentially systemic trend that may broadly affect the software industry.


On the Erd H o s P 'osa property for immersions and topological minors in tournaments. We consider the Erd H o s P 'osa property for immersions and topological minors in tournaments. We prove that for every simple digraph H , k in mathbb N , and tournament T , the following statements hold (i) If in T one cannot find k arc disjoint immersion copies of H , then there exists a set of mathcal O H(k 3) arcs that intersects all immersion copies of H in T . (ii) If in T one cannot find k vertex disjoint topological minor copies of H , then there exists a set of mathcal O H(k log k) vertices that intersects all topological minor copies of H in T . This improves the results of Raymond DMTCS '18 , who proved similar statements under the assumption that H is strongly connected.


Semiclassical two step model for ionization by a strong laser pulse Further developments and applications. We review the semiclassical two step model for strong field ionization. The semiclassical two step model describes quantum interference and accounts for the ionic potential beyond the semiclassical perturbation theory. We discuss formulation and implementation of this model, its further developments, as well as some of the applications. The reviewed applications of the model include strong field holography with photoelectrons, multielectron polarization effects in ionization by an intense laser pulse, and strong field ionization of the hydrogen molecule.


Simultaneous ambient pressure X ray photoelectron spectroscopy and grazing incidence X ray scattering in gas environments. We have developed an experimental system to simultaneously observe surface structure, morphology, composition, chemical state, and chemical activity for samples in gas phase environments. This is accomplished by simultaneously measuring X ray photoelectron spectroscopy (XPS) and grazing incidence X ray scattering (GIXS) in gas pressures as high as the multi Torr regime, while also recording mass spectrometry. Scattering patterns reflect near surface sample structures from the nano to the meso scale. The grazing incidence geometry provides tunable depth sensitivity while scattered X rays are detected across a broad range of angles using a newly designed pivoting UHV manipulator for detector positioning. At the same time, XPS and mass spectrometry can be measured, all from the same sample spot and in ambient conditions. To demonstrate the capabilities of this system, we measured the chemical state, composition, and structure of Ag behenate on a Si(001) wafer in vacuum and in O 2 atmosphere at various temperatures. These simultaneous structural, chemical, and gas phase product probes enable detailed insights into the interplay between structure and chemical state for samples in gas phase environments. The compact size of our pivoting UHV manipulator makes it possible to retrofit this technique into existing spectroscopic instruments installed at synchrotron beamlines. Because many synchrotron facilities are planning or undergoing upgrades to diffraction limited storage rings with transversely coherent beams, a newly emerging set of coherent X ray scattering experiments can greatly benefit from the concepts we present here.


Tur 'an Number for certain subdivisions. In this paper, we give a modest attempt to understand the extremal exponent for 1 subdivisions of non bipartite graphs. We obtain an upper bound for the extremal number of a family of graphs consisting of (possibly degenerate) 1 subdivisions of certain tripartite graphs. We also obtain results on the 1 subdivison of certain graph whose chromatic number is three.


An extension of the Lindstr "om Gessel Viennot theorem. Consider a weighted directed acyclic graph G having an upward planar drawing. We give a formula for the total weight of the families of non intersecting paths on G with any given starting and ending points. While the Lindstr "om Gessel Viennot theorem gives the signed enumeration of these weights (according to the connection type), our result provides the straight count, expressing it as a determinant whose entries are signed counts of lattice paths with given starting and ending points.


Function spaces, time derivatives and compactness for evolving families of Banach spaces with applications to PDEs. We develop a functional framework suitable for the treatment of partial differential equations and variational problems posed on evolving families of Banach spaces. We propose a definition for the weak time derivative which does not rely on the availability of an inner product or Hilbertian structure and explore conditions under which the spaces of weakly differentiable functions (with values in an evolving Banach space) relate to the classical Sobolev Bochner spaces. An Aubin Lions compactness result in this setting is also proved. We then analyse several concrete examples of function spaces over time evolving spatial domains and hypersurfaces for which we explicitly provide the definition of the time derivative and verify isomorphism properties with the aforementioned Sobolev Bochner spaces. We conclude with the formulation and proof of well posedness for a class of nonlinear monotone problems on an abstract evolving space (generalising in particular the evolutionary p Laplace equation on a moving domain or surface) and identify some additional evolutionary problems that can be appropriately formulated with the abstract setting developed in this work.


Mining the Weights Knowledge for Optimizing Neural Network Structures. Knowledge embedded in the weights of the artificial neural network can be used to improve the network structure, such as in network compression. However, the knowledge is set up by hand, which may not be very accurate, and relevant information may be overlooked. Inspired by how learning works in the mammalian brain, we mine the knowledge contained in the weights of the neural network toward automatic architecture learning in this paper. We introduce a switcher neural network (SNN) that uses as inputs the weights of a task specific neural network (called TNN for short). By mining the knowledge contained in the weights, the SNN outputs scaling factors for turning off and weighting neurons in the TNN. To optimize the structure and the parameters of TNN simultaneously, the SNN and TNN are learned alternately under the same performance evaluation of TNN using stochastic gradient descent. We test our method on widely used datasets and popular networks in classification applications. In terms of accuracy, we outperform baseline networks and other structure learning methods stably and significantly. At the same time, we compress the baseline networks without introducing any sparse induction mechanism, and our method, in particular, leads to a lower compression rate when dealing with simpler baselines or more difficult tasks. These results demonstrate that our method can produce a more reasonable structure.


Classification of the d representation finite trivial extensions of quiver algebras. We give a complete classification of all d representation finite symmetric Nakayama algebras, and of all d representation finite trivial extensions of path algebras of quivers, over an arbitrary field.


Probabilistic Tracking with Deep Factors. In many applications of computer vision it is important to accurately estimate the trajectory of an object over time by fusing data from a number of sources, of which 2D and 3D imagery is only one. In this paper, we show how to use a deep feature encoding in conjunction with generative densities over the features in a factor graph based, probabilistic tracking framework. We present a likelihood model that combines a learned feature encoder with generative densities over them, both trained in a supervised manner. We also experiment with directly inferring probability through the use of image classification models that feed into the likelihood formulation. These models are used to implement deep factors that are added to the factor graph to complement other factors that represent domain specific knowledge such as motion models and or other prior information. Factors are then optimized together in a non linear least squares tracking framework that takes the form of an Extended Kalman Smoother with a Gaussian prior. A key feature of our likelihood model is that it leverages the Lie group properties of the tracked target's pose to apply the feature encoding on an image patch, extracted through a differentiable warp function inspired by spatial transformer networks. To illustrate the proposed approach we evaluate it on a challenging social insect behavior dataset, and show that using deep features does outperform these earlier linear appearance models used in this setting.


BCD A Cross Architecture Binary Comparison Database Experiment Using Locality Sensitive Hashing Algorithms. Given a binary executable without source code, it is difficult to determine what each function in the binary does by reverse engineering it, and even harder without prior experience and context. In this paper, we performed a comparison of different hashing functions' effectiveness at detecting similar lifted snippets of LLVM IR code, and present the design and implementation of a framework for cross architecture binary code similarity search database using MinHash as the chosen hashing algorithm, over SimHash, SSDEEP and TLSH. The motivation is to help reverse engineers to quickly gain context of functions in an unknown binary by comparing it against a database of known functions. The code for this project is open source and can be found at https github.com h4sh5 bcddb


A Path based Approach to Analyzing the Global Liner Shipping Network. The maritime shipping network is the backbone of global trade. Data about the movement of cargo through this network comes in various forms, from ship level Automatic Identification System (AIS) data, to aggregated bilateral trade volume statistics. Multiple network representations of the shipping system can be derived from any one data source, each of which has advantages and disadvantages. In this work, we examine data in the form of liner shipping service routes, a list of walks through the port to port network aggregated from individual shipping companies by a large shipping logistics database. This data is inherently sequential, in that each route represents a sequence of ports called upon by a cargo ship. Previous work has analyzed this data without taking full advantage of the sequential information. Our contribution is to develop a path based methodology for analyzing liner shipping service route data, computing navigational trajectories through the network that respect the routes and comparing these paths with those computed using other network representations of the same data. We further use these trajectories to re analyze the role of a previously identified structural core through the network, as well as to define and analyze a measure of betweenness centrality for nodes and edges.


Wavelength sensitivity of the speckle patterns produced by an integrating sphere. Speckle metrology is a powerful tool in the measurement of wavelength and spectra. Recently, speckle produced by multiple reflections inside an integrating sphere has been proposed and showed high performance. However, to our knowledge, a complete characterisation of speckle sensitivity to wavelength in that geometry has not been performed to date. In this work, we derive a general model predicting the variation in a speckle pattern as a result of a generic transformation. Applying this to a shift in the incident wavelength, we show that the speckle sensitivity is mainly governed by the radius and surface reflectivity of the sphere. We show that integrating spheres offer sensitivity three orders of magnitude above that of multimode fibres of a similar size, and discuss analogies with the transmission line of a Fabry P 'erot interferometer.


Disentangling Parallelism and Interference in Game Semantics. Game semantics is a denotational semantics presenting compositionally the computational behaviour of various kinds of effectful programs. One of its celebrated achievement is to have obtained full abstraction results for programming languages with a variety of computational effects, in a single framework. This is known as the semantic cube or Abramsky's cube, which for sequential deterministic programs establishes a correspondence between certain conditions on strategies (''innocence'', ''well bracketing'', ''visibility'') and the absence of matching computational effects. Outside of the sequential deterministic realm, there are still a wealth of game semantics based full abstraction results but they no longer fit in a unified canvas. In particular, Ghica and Murawski's fully abstract model for shared state concurrency (IA) does not have a matching notion of pure parallel program we say that parallelism and interference (i.e. state plus semaphores) are entangled. In this paper we construct a causal version of Ghica and Murawski's model, also fully abstract for IA. We provide compositional conditions parallel innocence and sequentiality, respectively banning interference and parallelism, and leading to four full abstraction results. To our knowledge, this is the first extension of Abramsky's semantic cube programme beyond the sequential deterministic world.


Proof of the impossibility of probabilistic induction. In this short note I restate and simplify the proof of the impossibility of probabilistic induction from Popper (1992). Other proofs are possible (cf. Popper (1985)).


An Analysis Of Entire Space Multi Task Models For Post Click Conversion Prediction. Industrial recommender systems are frequently tasked with approximating probabilities for multiple, often closely related, user actions. For example, predicting if a user will click on an advertisement and if they will then purchase the advertised product. The conceptual similarity between these tasks has promoted the use of multi task learning a class of algorithms that aim to bring positive inductive transfer from related tasks. Here, we empirically evaluate multi task learning approaches with neural networks for an online advertising task. Specifically, we consider approximating the probability of post click conversion events (installs) (CVR) for mobile app advertising on a large scale advertising platform, using the related click events (CTR) as an auxiliary task. We use an ablation approach to systematically study recent approaches that incorporate both multitask learning and "entire space modeling" which train the CVR on all logged examples rather than learning a conditional likelihood of conversion given clicked. Based on these results we show that several different approaches result in similar levels of positive transfer from the data abundant CTR task to the CVR task and offer some insight into how the multi task design choices address the two primary problems affecting the CVR task data sparsity and data bias. Our findings add to the growing body of evidence suggesting that standard multi task learning is a sensible approach to modelling related events in real world large scale applications and suggest the specific multitask approach can be guided by ease of implementation in an existing system.


Optimal error estimation of a time spectral method for fractional diffusion problems with low regularity data. This paper is devoted to the error analysis of a time spectral algorithm for fractional diffusion problems of order alpha ( 0 alpha 1 ). The solution regularity in the Sobolev space is revisited, and new regularity results in the Besov space are established. A time spectral algorithm is developed which adopts a standard spectral method and a conforming linear finite element method for temporal and spatial discretizations, respectively. Optimal error estimates are derived with nonsmooth data. Particularly, a sharp temporal convergence rate 1 2 alpha is shown theoretically and numerically.


Hierarchical Clustering O(1) Approximation for Well Clustered Graphs. Hierarchical clustering studies a recursive partition of a data set into clusters of successively smaller size, and is a fundamental problem in data analysis. In this work we study the cost function for hierarchical clustering introduced by Dasgupta, and present two polynomial time approximation algorithms Our first result is an O(1) approximation algorithm for graphs of high conductance. Our simple construction bypasses complicated recursive routines of finding sparse cuts known in the literature. Our second and main result is an O(1) approximation algorithm for a wide family of graphs that exhibit a well defined structure of clusters. This result generalises the previous state of the art, which holds only for graphs generated from stochastic models. The significance of our work is demonstrated by the empirical analysis on both synthetic and real world data sets, on which our presented algorithm outperforms the previously proposed algorithm for graphs with a well defined cluster structure.


A Robust Algebraic Domain Decomposition Preconditioner for Sparse Normal Equations. Solving the normal equations corresponding to large sparse linear least squares problems is an important and challenging problem. For very large problems, an iterative solver is needed and, in general, a preconditioner is required to achieve good convergence. In recent years, a number of preconditioners have been proposed. These are largely serial and reported results demonstrate that none of the commonly used preconditioners for the normal equations matrix is capable of solving all sparse least squares problems. Our interest is thus in designing new preconditioners for the normal equations that are efficient, robust, and can be implemented in parallel. Our proposed preconditioners can be constructed efficiently and algebraically without any knowledge of the problem and without any assumption on the least squares matrix except that it is sparse. We exploit the structure of the symmetric positive definite normal equations matrix and use the concept of algebraic local symmetric positive semi definite splittings to introduce two level Schwarz preconditioners for least squares problems. The condition number of the preconditioned normal equations is shown to be theoretically bounded independently of the number of subdomains in the splitting. This upper bound can be adjusted using a single parameter tau that the user can specify. We discuss how the new preconditioners can be implemented on top of the PETSc library using only 150 lines of Fortran, C, or Python code. Problems arising from practical applications are used to compare the performance of the proposed new preconditioner with that of other preconditioners.


A Survey on Synchronous Augmented, Virtual and Mixed Reality Remote Collaboration Systems. Remote collaboration systems have become increasingly important in today's society, especially during times where physical distancing is advised. Industry, research and individuals face the challenging task of collaborating and networking over long distances. While video and teleconferencing are already widespread, collaboration systems in augmented, virtual, and mixed reality are still a niche technology. We provide an overview of recent developments of synchronous remote collaboration systems and create a taxonomy by dividing them into three main components that form such systems Environment, Avatars, and Interaction. A thorough overview of existing systems is given, categorising their main contributions in order to help researchers working in different fields by providing concise information about specific topics such as avatars, virtual environment, visualisation styles and interaction. The focus of this work is clearly on synchronised collaboration from a distance. A total of 82 unique systems for remote collaboration are discussed, including more than 100 publications and 25 commercial systems.


CTRN Class Temporal Relational Network for Action Detection. Action detection is an essential and challenging task, especially for densely labelled datasets of untrimmed videos. There are many real world challenges in those datasets, such as composite action, co occurring action, and high temporal variation of instance duration. For handling these challenges, we propose to explore both the class and temporal relations of detected actions. In this work, we introduce an end to end network Class Temporal Relational Network (CTRN). It contains three key components (1) The Representation Transform Module filters the class specific features from the mixed representations to build graph structured data. (2) The Class Temporal Module models the class and temporal relations in a sequential manner. (3) G classifier leverages the privileged knowledge of the snippet wise co occurring action pairs to further improve the co occurring action detection. We evaluate CTRN on three challenging densely labelled datasets and achieve state of the art performance, reflecting the effectiveness and robustness of our method.


Straight to the Gradient Learning to Use Novel Tokens for Neural Text Generation. Advanced large scale neural language models have led to significant success in many language generation tasks. However, the most commonly used training objective, Maximum Likelihood Estimation (MLE), has been shown problematic, where the trained model prefers using dull and repetitive phrases. In this work, we introduce ScaleGrad, a modification straight to the gradient of the loss function, to remedy the degeneration issue of the standard MLE objective. By directly maneuvering the gradient information, ScaleGrad makes the model learn to use novel tokens. Empirical results show the effectiveness of our method not only in open ended generation, but also in directed generation tasks. With the simplicity in architecture, our method can serve as a general training objective that is applicable to most of the neural text generation tasks.


Changing Software Engineers' Self Efficacy with Bootcamps A Research Proposal. In several areas of knowledge, self efficacy is related to the perfomance of individuals, including in Software Engineering. However,it is not clear how self efficacy can be modified in training conducted by the industry. Furthermore, we still do not understand how self efficacy can impact an individual's team and career in the industry. This lack of understanding can negatively impact how companies and individuals perceive the importance of self efficacy in the field. Therefore, We present a research proposal that aims to understand the relationship between self efficacy and training in Software Engineering. Moreover, we look to understand the role of self efficacy at Software Development industry. We propose a longitudinal case study with software engineers at Zup Innovation that participating of our bootcamp training. We expect to collect data to support our assumptions that self efficacy can be related to training in Software Engineering. The other assumption is that self efficacy at the beginning of training is higher than the middle, and that self efficacy at the end of training is higher than the middle. We expect that the study proposed in this article will motivate a discussion about self efficacy and the importance of training employers in the industry of software development.


De rendering Stylized Texts. Editing raster text is a promising but challenging task. We propose to apply text vectorization for the task of raster text editing in display media, such as posters, web pages, or advertisements. In our approach, instead of applying image transformation or generation in the raster domain, we learn a text vectorization model to parse all the rendering parameters including text, location, size, font, style, effects, and hidden background, then utilize those parameters for reconstruction and any editing task. Our text vectorization takes advantage of differentiable text rendering to accurately reproduce the input raster text in a resolution free parametric format. We show in the experiments that our approach can successfully parse text, styling, and background information in the unified model, and produces artifact free text editing compared to a raster baseline.


Self Supervised Regional and Temporal Auxiliary Tasks for Facial Action Unit Recognition. Automatic facial action unit (AU) recognition is a challenging task due to the scarcity of manual annotations. To alleviate this problem, a large amount of efforts has been dedicated to exploiting various methods which leverage numerous unlabeled data. However, many aspects with regard to some unique properties of AUs, such as the regional and relational characteristics, are not sufficiently explored in previous works. Motivated by this, we take the AU properties into consideration and propose two auxiliary AU related tasks to bridge the gap between limited annotations and the model performance in a self supervised manner via the unlabeled data. Specifically, to enhance the discrimination of regional features with AU relation embedding, we design a task of RoI inpainting to recover the randomly cropped AU patches. Meanwhile, a single image based optical flow estimation task is proposed to leverage the dynamic change of facial muscles and encode the motion information into the global feature representation. Based on these two self supervised auxiliary tasks, local features, mutual relation and motion cues of AUs are better captured in the backbone network with the proposed regional and temporal based auxiliary task learning (RTATL) framework. Extensive experiments on BP4D and DISFA demonstrate the superiority of our method and new state of the art performances are achieved.


Privacy Preserving and Resilient RPKI. Resource Public Key Infrastructure (RPKI) is vital to the security of inter domain routing. However, RPKI enables Regional Internet Registries (RIRs) to unilaterally takedown IP prefixes indeed, such attacks have been launched by nation state adversaries. The threat of IP prefix takedowns is one of the factors hindering RPKI adoption. In this work, we propose the first distributed RPKI system, based on threshold signatures, that requires the coordination of a number of RIRs to make changes to RPKI objects hence, preventing unilateral prefix takedown. We perform extensive evaluations using our implementation demonstrating the practicality of our solution. Furthermore, we show that our system is scalable and remains efficient even when RPKI is widely deployed.


Random Walk steered Majority Undersampling. In this work, we propose Random Walk steered Majority Undersampling (RWMaU), which undersamples the majority points of a class imbalanced dataset, in order to balance the classes. Rather than marking the majority points which belong to the neighborhood of a few minority points, we are interested to perceive the closeness of the majority points to the minority class. Random walk, a powerful tool for perceiving the proximities of connected points in a graph, is used to identify the majority points which lie close to the minority class of a class imbalanced dataset. The visit frequencies and the order of visits of the majority points in the walks enable us to perceive an overall closeness of the majority points to the minority class. The ones lying close to the minority class are subsequently undersampled. Empirical evaluation on 21 datasets and 3 classifiers demonstrate substantial improvement in performance of RWMaU over the competing methods.


A novel approach for MBSFN Area Formation aided by D2D Communications for eMBB Service Delivery in 5G NR Systems. Forthcoming 5G New Radio (NR) systems will be asked to handle a huge number of devices accessing or delivering "resource hungry" and high quality services. In view of this, the new 5G Radio Access Technology (RAT) aims to support, in next releases, Multimedia Broadcast Multicast Service Single Frequency Network (MBSFN) to enable the simultaneous delivery of the same content to a set of users covered by different cells. According to MBSFN, all cells belonging to the same MBSFN Area are synchronized in time and the MBSFN transmission occurs over the same radio resources. In such a way, the same content flow is delivered by several cells to all the receivers in the MBSFN Area. A further means to enhance the network coverage and provide high data rate and low latency in future 5G enabled MBSFN networks is Device to Device (D2D) connectivity. Along these lines, in this paper we propose a D2D aided MBSFN Area Formation (D2D MAF) algorithm to dynamically create MBSFN Areas with the aim to improve the system aggregate data rate while satisfying all user requests. The proposed D2D MAF foresees that users could receive the service through either MBSFN, or D2D, or unicast transmissions. Performance evaluation results, carried out under a wide range of conditions, testify to the high effectiveness of the proposed algorithm.


Space time Non local multi continua upscaling for parabolic equations with moving channelized media. In this paper, we consider a parabolic problem with time dependent heterogeneous coefficients. Many applied problems have coupled space and time heterogeneities. Their homogenization or upscaling requires cell problems that are formulated in space time representative volumes for problems with scale separation. In problems without scale separation, local problems include multiple macroscopic variables and oversampled local problems, where these macroscopic parameters are computed. These approaches, called Non local multi continua, are proposed for problems with complex spatial heterogeneities in a number of previous papers. In this paper, we extend this approach for space time heterogeneities, by identifying macroscopic parameters in space time regions. Our proposed method space time Non local multi continua (space time NLMC) is an efficient numerical solver to deal with time dependent heterogeneous coefficients. It provides a flexible and systematic way to construct multiscale basis functions to approximate the solution. These multiscale basis functions are constructed by solving a local energy minimization problems in the oversampled space time regions such that these multiscale basis functions decay exponentially outside the oversampled domain. Unlike the classical time stepping methods combined with full discretization technique, our space time NLMC efficiently constructs the multiscale basis functions in a space time domain and can provide a computational savings compared to space only approaches as we discuss in the paper. We present two numerical experiments, which show that the proposed approach can provide a good accuracy.


Screening of resonant magnetic perturbation penetration by flows in tokamak plasmas based on two fluid model. Numerical simulation on the resonant magnetic perturbation penetration is carried out by the newly updated initial value code MDC (MHD Dalian Code). Based on a set of two fluid four field equations, the bootstrap current, parallel and perpendicular transport effects are included appropriately. Taking into account the bootstrap current, a mode penetration like phenomenon is found, which is essentially different from the classical tearing mode model. It may provide a possible explanation for the finite mode penetration threshold at zero rotation detected in experiments. To reveal the influence of diamagnetic drift flow on the mode penetration process, bf E times B drift flow and diamagnetic drift flow are separately applied to compare their effects. Numerical results show that, a sufficiently large diamagnetic drift flow can drive a strong stabilizing effect on the neoclassical tearing mode. Furthermore, an oscillation phenomenon of island width is discovered. By analyzing in depth, it is found that, this oscillation phenomenon is due to the negative feedback regulation of pressure on the magnetic island. This physical mechanism is verified again by key parameter scanning.


Improving Human Decisions by Adjusting the Alerting Thresholds for Computer Alerting Tools According to User and Task Characteristics. Objective To investigate whether performance (number of correct decisions) of humans supported by a computer alerting tool can be improved by tailoring the tool's alerting threshold (sensitivity specificity combination) according to user ability and task difficulty. Background Many researchers implicitly assume that for each tool there exists a single ideal threshold. But research shows the effects of alerting tools on decision errors to vary depending on variables such as user ability and task difficulty. These findings motivated our investigation. Method Forty seven participants edited text passages, aided by a simulated spell checker tool. We experimentally manipulated passage difficulty and tool alerting threshold, measured participants' editing and dictation ability, and counted participants' decision errors (false positives false negatives). We investigated whether alerting threshold, user ability, task difficulty and their interactions affected error count. Results Which alerting threshold better helped a user depended on an interaction between user ability and passage difficulty. Some effects were large for higher ability users, a more sensitive threshold reduced errors by 30 , on the easier passages. Participants were not significantly more likely to prefer the alerting threshold with which they performed better. Conclusion Adjusting alerting thresholds for individual users' ability and task difficulty could substantially improve effects of automated alerts on user decisions. This potential deserves further investigation. Improvement size and rules for adjustment will be application specific. Application Computer alerting tools have critical roles in many domains. Designers should assess potential benefits of adjustable alerting thresholds for their specific CAT application. Guidance for choosing thresholds will be essential for realizing these benefits in practice.


Communication Efficient Distributed SGD using Preamble based Random Access. In this paper, we study communication efficient distributed stochastic gradient descent (SGD) with data sets of users distributed over a certain area and communicating through wireless channels. Since the time for one iteration in the proposed approach is independent of the number of users, it is well suited to scalable distributed SGD. Furthermore, since the proposed approach is based on preamble based random access, which is widely adopted for machine type communication (MTC), it can be easily employed for training models with a large number of devices in various Internet of Things (IoT) applications where MTC is used for their connectivity. For fading channel, we show that noncoherent combining can be used. As a result, no channel state information (CSI) estimation is required. From analysis and simulation results, we can confirm that the proposed approach is not only scalable, but also provides improved performance as the number of devices increases.


GELATO Geometrically Enriched Latent Model for Offline Reinforcement Learning. Offline reinforcement learning approaches can generally be divided to proximal and uncertainty aware methods. In this work, we demonstrate the benefit of combining the two in a latent variational model. We impose a latent representation of states and actions and leverage its intrinsic Riemannian geometry to measure distance of latent samples to the data. Our proposed metrics measure both the quality of out of distribution samples as well as the discrepancy of examples in the data. We integrate our metrics in a model based offline optimization framework, in which proximity and uncertainty can be carefully controlled. We illustrate the geodesics on a simple grid like environment, depicting its natural inherent topology. Finally, we analyze our approach and improve upon contemporary offline RL benchmarks.


L infty liftings of semiregularity maps via Chern Simons classes. We introduce the notion of Chern Simons classes for curved DG pairs and we prove that a particular case of this general construction provides canonical L infty liftings of Buchweitz Flenner semiregularity maps for coherent sheaves on complex manifolds.


On the Effect of Pruning on Adversarial Robustness. Pruning is a well known mechanism for reducing the computational cost of deep convolutional networks. However, studies have shown the potential of pruning as a form of regularization, which reduces overfitting and improves generalization. We demonstrate that this family of strategies provides additional benefits beyond computational performance and generalization. Our analyses reveal that pruning structures (filters and or layers) from convolutional networks increase not only generalization but also robustness to adversarial images (natural images with content modified). Such achievements are possible since pruning reduces network capacity and provides regularization, which have been proven effective tools against adversarial images. In contrast to promising defense mechanisms that require training with adversarial images and careful regularization, we show that pruning obtains competitive results considering only natural images (e.g., the standard and low cost training). We confirm these findings on several adversarial attacks and architectures thus suggesting the potential of pruning as a novel defense mechanism against adversarial images.


Risk Averse Biased Human Policies in Assistive Multi Armed Bandit Settings. Assistive multi armed bandit problems can be used to model team situations between a human and an autonomous system like a domestic service robot. To account for human biases such as the risk aversion described in the Cumulative Prospect Theory, the setting is expanded to using observable rewards. When robots leverage knowledge about the risk averse human model they eliminate the bias and make more rational choices. We present an algorithm that increases the utility value of such human robot teams. A brief evaluation indicates that arbitrary reward functions can be handled.


Stream processors and comodels. In 2009, Ghani, Hancock and Pattinson gave a coalgebraic characterisation of stream processors A mathbb N to B mathbb N drawing on ideas of Brouwerian constructivism. Their stream processors have an intensional character in this paper, we give a corresponding coalgebraic characterisation of extensional stream processors, i.e., the set of continuous functions A mathbb N to B mathbb N . Our account sites both our result and that of op. cit. within the apparatus of comodels for algebraic effects originating with Power Shkaravska. Within this apparatus, the distinction between intensional and extensional equivalence for stream processors arises in the same way as the the distinction between bisimulation and trace equivalence for labelled transition systems and probabilistic generative systems.


TOD Tensor based Outlier Detection. To scale outlier detection (OD) to large scale, high dimensional datasets, we propose TOD, a novel system that abstracts OD algorithms into basic tensor operations for efficient GPU acceleration. To make TOD highly efficient in both time and space, we leverage recent advances in deep learning infrastructure in both hardware and software. To deploy large OD applications on GPUs with limited memory, we introduce two key techniques. First, provable quantization accelerates OD computation and reduces the memory requirement by performing specific OD computations in lower precision while provably guaranteeing no accuracy loss. Second, to exploit the aggregated compute resources and memory capacity of multiple GPUs, we introduce automatic batching, which decomposes OD computations into small batches that can be executed on multiple GPUs in parallel. TOD supports a comprehensive set of OD algorithms and utility functions. Extensive evaluation on both real and synthetic OD datasets shows that TOD is on average 11.9X faster than the state of the art comprehensive OD system PyOD, and takes less than an hour to detect outliers within a million samples. TOD enables straightforward integration for additional OD algorithms and provides a unified framework for combining classical OD algorithms with deep learning methods. These combinations result in an infinite number of OD methods, many of which are novel and can be easily prototyped in TOD.


Euro PVI Pedestrian Vehicle Interactions in Dense Urban Centers. Accurate prediction of pedestrian and bicyclist paths is integral to the development of reliable autonomous vehicles in dense urban environments. The interactions between vehicle and pedestrian or bicyclist have a significant impact on the trajectories of traffic participants e.g. stopping or turning to avoid collisions. Although recent datasets and trajectory prediction approaches have fostered the development of autonomous vehicles yet the amount of vehicle pedestrian (bicyclist) interactions modeled are sparse. In this work, we propose Euro PVI, a dataset of pedestrian and bicyclist trajectories. In particular, our dataset caters more diverse and complex interactions in dense urban scenarios compared to the existing datasets. To address the challenges in predicting future trajectories with dense interactions, we develop a joint inference model that learns an expressive multi modal shared latent space across agents in the urban scene. This enables our Joint beta cVAE approach to better model the distribution of future trajectories. We achieve state of the art results on the nuScenes and Euro PVI datasets demonstrating the importance of capturing interactions between ego vehicle and pedestrians (bicyclists) for accurate predictions.


Reranking Machine Translation Hypotheses with Structured and Web based Language Models. In this paper, we investigate the use of linguistically motivated and computationally efficient structured language models for reranking N best hypotheses in a statistical machine translation system. These language models, developed from Constraint Dependency Grammar parses, tightly integrate knowledge of words, morphological and lexical features, and syntactic dependency constraints. Two structured language models are applied for N best rescoring, one is an almost parsing language model, and the other utilizes more syntactic features by explicitly modeling syntactic dependencies between words. We also investigate effective and efficient language modeling methods to use N grams extracted from up to 1 teraword of web documents. We apply all these language models for N best re ranking on the NIST and DARPA GALE program 2006 and 2007 machine translation evaluation tasks and find that the combination of these language models increases the BLEU score up to 1.6 absolutely on blind test sets.


Comparing Hand Gestures and a Gamepad Interface for Locomotion in Virtual Environments. Hand gesture is a new and promising interface for locomotion in virtual environments. While several previous studies have proposed different hand gestures for virtual locomotion, little is known about their differences in terms of performance and user preference in virtual locomotion tasks. In the present paper, we presented three different hand gesture interfaces and their algorithms for locomotion, which are called the Finger Distance gesture, the Finger Number gesture and the Finger Tapping gesture. These gestures were inspired by previous studies of gesture based locomotion interfaces and are typical gestures that people are familiar with in their daily lives. Implementing these hand gesture interfaces in the present study enabled us to systematically compare the differences between these gestures. In addition, to compare the usability of these gestures to locomotion interfaces using gamepads, we also designed and implemented a gamepad interface based on the Xbox One controller. We compared these four interfaces through two virtual locomotion tasks. These tasks assessed their performance and user preference on speed control and waypoints navigation. Results showed that user preference and performance of the Finger Distance gesture were comparable to that of the gamepad interface. The Finger Number gesture also had close performance and user preference to that of the Finger Distance gesture. Our study demonstrates that the Finger Distance gesture and the Finger Number gesture are very promising interfaces for virtual locomotion. We also discuss that the Finger Tapping gesture needs further improvements before it can be used for virtual walking.


String Sampling with Bidirectional String Anchors. The minimizers sampling mechanism is a popular mechanism for string sampling introduced independently by Schleimer et al. SIGMOD 2003 and by Roberts et al. Bioinf. 2004 . Given two positive integers w and k , it selects the lexicographically smallest length k substring in every fragment of w consecutive length k substrings (in every sliding window of length w k 1 ). Minimizers samples are approximately uniform, locally consistent, and computable in linear time. Two main disadvantages of minimizers sampling mechanisms are first, they do not have good guarantees on the expected size of their samples for every combination of w and k and, second, indexes that are constructed over their samples do not have good worst case guarantees for on line pattern searches. We introduce bidirectional string anchors (bd anchors), a new string sampling mechanism. Given a positive integer ell , our mechanism selects the lexicographically smallest rotation in every length ell fragment (in every sliding window of length ell ). We show that bd anchors samples are also approximately uniform, locally consistent, and computable in linear time. In addition, our experiments using several datasets demonstrate that the bd anchors sample sizes decrease proportionally to ell and that these sizes are competitive to or smaller than the minimizers sample sizes using the analogous sampling parameters. We provide theoretical justification for these results by analyzing the expected size of bd anchors samples. As a negative result, we show that computing a total order leq on the input alphabet, which minimizes the bd anchors sample size, is NP hard. We also show that by using any bd anchors sample, we can construct, in near linear time, an index which requires linear (extra) space in the size of the sample and answers on line pattern searches in near optimal time.


Multi modal Understanding and Generation for Medical Images and Text via Vision Language Pre Training. Recently a number of studies demonstrated impressive performance on diverse vision language multimodal tasks such as image captioning and visual question answering by extending the self attention based Transformer architecture with multimodal pre training objectives. Despite its huge potential, vision language multimodal pre training in the medical domain has only recently received attention, and only demonstrated improved diagnosis accuracy of vision language pre trained models. In this work we explore a broad set of multimodal representation learning tasks in the medical domain, specifically using radiology images and the unstructured report. We propose a new model which adopts a Transformer based architecture combined with a novel multimodal attention masking scheme to maximize generalization performance for both vision language understanding task (e.g., diagnosis classification) and vision language generation task (e.g., radiology report generation). By rigorously evaluating the proposed model on four downstream tasks with three radiographic image text datasets (MIMIC CXR, Open I, and VQA RAD), we empirically demonstrate the superior downstream task performance and generality of our model against various baselines including task specific architectures. In addition, we qualitatively analyze our model by showing the results of retrieved image report pairs, the attention map visualization, and generated reports. Our proposed multimodal pre training model could flexibly adapt to multiple downstream tasks of vision language understanding and generation with a novel self attention scheme. We believe that our approach can provide the basis for a wide range of interpretations of vision language multimodal in the medical domain.


Pix2seq A Language Modeling Framework for Object Detection. We present Pix2Seq, a simple and generic framework for object detection. Unlike existing approaches that explicitly integrate prior knowledge about the task, we cast object detection as a language modeling task conditioned on the observed pixel inputs. Object descriptions (e.g., bounding boxes and class labels) are expressed as sequences of discrete tokens, and we train a neural network to perceive the image and generate the desired sequence. Our approach is based mainly on the intuition that if a neural network knows about where and what the objects are, we just need to teach it how to read them out. Beyond the use of task specific data augmentations, our approach makes minimal assumptions about the task, yet it achieves competitive results on the challenging COCO dataset, compared to highly specialized and well optimized detection algorithms.


How to See Hidden Patterns in Metamaterials with Interpretable Machine Learning. Metamaterials are composite materials with engineered geometrical micro and meso structures that can lead to uncommon physical properties, like negative Poisson's ratio or ultra low shear resistance. Periodic metamaterials are composed of repeating unit cells, and geometrical patterns within these unit cells influence the propagation of elastic or acoustic waves and control dispersion. In this work, we develop a new interpretable, multi resolution machine learning framework for finding patterns in the unit cells of materials that reveal their dynamic properties. Specifically, we propose two new interpretable representations of metamaterials, called shape frequency features and unit cell templates. Machine learning models built using these feature classes can accurately predict dynamic material properties. These feature representations (particularly the unit cell templates) have a useful property they can operate on designs of higher resolutions. By learning key coarse scale patterns that can be reliably transferred to finer resolution design space via the shape frequency features or unit cell templates, we can almost freely design the fine resolution features of the unit cell without changing coarse scale physics. Through this multi resolution approach, we are able to design materials that possess target frequency ranges in which waves are allowed or disallowed to propagate (frequency bandgaps). Our approach yields major benefits (1) unlike typical machine learning approaches to materials science, our models are interpretable, (2) our approaches leverage multi resolution properties, and (3) our approach provides design flexibility.


Towards a statistical physics of dating apps. Over the last ten years, a sharp rise in the number of dating apps has broadened the spectrum of how one can get in contact with new acquaintances. A common feature of such apps is a swipe enabling a user to decide whether to like or dislike another user. As is the case in real life, a user may be more or less popular, which implies the distribution of likes among different users is not trivial. In this paper we show how likes are distributed across users, based on different decision making strategies and on different app settings. We apply theoretical methods originally developed in stochastic and coagulation processes to the investigation into the dynamics of dating app networks. More specifically, we show that whenever a dating app differentially displays different users with respect to their popularity in different models, users are split into two categories a first category including users who have received most likes and a second category, referred to as a condensate, which in the long term will be reduced to a small fraction of likes or to no likes at all. Finally, we explore different models based on a rating system of the users, known as Elo. These models will turn out to exhibit behaviour typical of gelating systems and non trivial distribution of Elo rating.


Adaptive Simulated Annealing with Greedy Search for the Circle Bin Packing Problem. We introduce a new bin packing problem, termed the circle bin packing problem with circular items (CBPP CI). The problem involves packing all the circular items into multiple identical circle bins as compact as possible with the objective of minimizing the number of used bins. We first define the tangent occupying action (TOA) and propose a constructive greedy algorithm that sequentially packs the items into places tangent to the packed items or the bin boundaries. Moreover, to avoid falling into a local minimum trap and efficiently judge whether an optimal solution has been established, we continue to present the adaptive simulated annealing with greedy search (ASA GS) algorithm that explores and exploits the search space efficiently. Specifically, we offer two novel local perturbation strategies to jump out of the local optimum and incorporate the greedy search to achieve faster convergence. The parameters of ASA GS are adaptive according to the number of items so that they can be size agnostic across the problem scale. We design two sets of new benchmark instances, and the empirical results show that ASA GS completely outperforms the constructive greedy algorithm. Moreover, the packing density of ASA GS on the top few dense bins is much higher than that of the state of the art algorithm for the single circle packing problem, inferring the high quality of the packing solutions for CBPP CI.


A Deep Learning Approach for Macroscopic Energy Consumption Prediction with Microscopic Quality for Electric Vehicles. This paper presents a machine learning approach to model the electric consumption of electric vehicles at macroscopic level, i.e., in the absence of a speed profile, while preserving microscopic level accuracy. For this work, we leveraged a high performance, agent based transportation tool to model trips that occur in the Greater Chicago region under various scenario changes, along with physics based modeling and simulation tools to provide high fidelity energy consumption values. The generated results constitute a very large dataset of vehicle route energy outcomes that capture variability in vehicle and routing setting, and in which high fidelity time series of vehicle speed dynamics is masked. We show that although all internal dynamics that affect energy consumption are masked, it is possible to learn aggregate level energy consumption values quite accurately with a deep learning approach. When large scale data is available, and with carefully tailored feature engineering, a well designed model can overcome and retrieve latent information. This model has been deployed and integrated within POLARIS Transportation System Simulation Tool to support real time behavioral transportation models for individual charging decision making, and rerouting of electric vehicles.


On the distribution of alpha p 2 modulo one with prime p of a special form. Let mathcal P r denote an almost prime with at most r prime factors, counted according to multiplicity. In this paper, it is proved that for alpha in mathbb R backslash mathbb Q , , beta in mathbb R and 0 theta 10 1561 , there exist infinitely many primes p , such that alpha p 2 beta p theta and p 2 mathcal P 4 , which constitutes an improvement upon the previous result.


Quantitative bounds on Impedance to Impedance operators with applications to fast direct solvers for PDEs. We prove quantitative norm bounds for a family of operators involving impedance boundary conditions on convex, polygonal domains. A robust numerical construction of Helmholtz scattering solutions in variable media via the Dirichlet to Neumann operator involves a decomposition of the domain into a sequence of rectangles of varying scales and constructing impedance to impedance boundary operators on each subdomain. Our estimates in particular ensure the invertibility, with quantitative bounds in the frequency, of the merge operators required to reconstruct the original Dirichlet to Neumann operator in terms of these impedance to impedance operators of the sub domains. A key step in our proof is to obtain Neumann and Dirichlet boundary trace estimates on solutions of the impedance problem, which are of independent interest. In addition to the variable media setting, we also construct bounds for similar merge operators in the obstacle scattering problem.


Optical parametric oscillation based chi (2) frequency comb in a lithium niobate microresonator. Microresonator frequency combs based on the chi (3) nonlinearity are nowadays well understood and making their way into different applications. Recently, microresonator frequency combs based on the chi (2) nonlinearity are receiving increasing attention, as they promise certain benefits, but still require further study. Here, we demonstrate the generation of a chi (2) frequency comb, initiated via optical parametric oscillation (OPO) in a lithium niobate mm sized microresonator. By pumping at 532 nm with 30 mu W of power, we observe 1 THz wide comb spectra around 1064 nm with degenerate and non degenerate states. We also show that comb generation requires signal and idler waves to be degenerate in mode numbers and how the fulfillment of this condition can be identified from the temperature tuning curves. The results demonstrate the potential to directly generate frequency combs via OPO beyond 3 mu m wavelengths in the mid IR by puming in the near IR region.


Topology Applied to Machine Learning From Global to Local. Through the use of examples, we explain one way in which applied topology has evolved since the birth of persistent homology in the early 2000s. The first applications of topology to data emphasized the global shape of a dataset, such as the three circle model for 3 times 3 pixel patches from natural images, or the configuration space of the cyclo octane molecule, which is a sphere with a Klein bottle attached via two circles of singularity. In these studies of global shape, short persistent homology bars are disregarded as sampling noise. More recently, however, persistent homology has been used to address questions about the local geometry of data. For instance, how can local geometry be vectorized for use in machine learning problems? Persistent homology and its vectorization methods, including persistence landscapes and persistence images, provide popular techniques for incorporating both local geometry and global topology into machine learning. Our meta hypothesis is that the short bars are as important as the long bars for many machine learning tasks. In defense of this claim, we survey applications of persistent homology to shape recognition, agent based modeling, materials science, archaeology, and biology. Additionally, we survey work connecting persistent homology to geometric features of spaces, including curvature and fractal dimension, and various methods that have been used to incorporate persistent homology into machine learning.


Cyber Intrusion Detection by Using Deep Neural Networks with Attack sharing Loss. Cyber attacks pose crucial threats to computer system security, and put digital treasuries at excessive risks. This leads to an urgent call for an effective intrusion detection system that can identify the intrusion attacks with high accuracy. It is challenging to classify the intrusion events due to the wide variety of attacks. Furthermore, in a normal network environment, a majority of the connections are initiated by benign behaviors. The class imbalance issue in intrusion detection forces the classifier to be biased toward the majority benign class, thus leave many attack incidents undetected. Spurred by the success of deep neural networks in computer vision and natural language processing, in this paper, we design a new system named DeepIDEA that takes full advantage of deep learning to enable intrusion detection and classification. To achieve high detection accuracy on imbalanced data, we design a novel attack sharing loss function that can effectively move the decision boundary towards the attack classes and eliminates the bias towards the majority benign class. By using this loss function, DeepIDEA respects the fact that the intrusion mis classification should receive higher penalty than the attack mis classification. Extensive experimental results on three benchmark datasets demonstrate the high detection accuracy of DeepIDEA. In particular, compared with eight state of the art approaches, DeepIDEA always provides the best class balanced accuracy.


Tracing Vulnerable Code Lineage. This paper presents results from the MSR 2021 Hackathon. Our team investigates files projects that contain known security vulnerabilities and how widespread they are throughout repositories in open source software. These security vulnerabilities can potentially be propagated through code reuse even when the vulnerability is fixed in different versions of the code. We utilize the World of Code infrastructure to discover file level duplication of code from a nearly complete collection of open source software. This paper describes a method and set of tools to find all open source projects that use known vulnerable files and any previous revisions of those files.


A q deformation of an algebra of Klyachko and Macdonald's reduced word formula. There is a striking similarity between Macdonald's reduced word formula and the image of the Schubert class in the cohomology ring of the permutahedral variety mathrm Perm n as computed by Klyachko. Toward understanding this better, we undertake an in depth study of a q deformation of the mathbb S n invariant part of the rational cohomology ring of mathrm Perm n , which we call the q Klyachko algebra. We uncover intimate links between expansions in the basis of squarefree monomials in this algebra and various notions in algebraic combinatorics, thereby connecting seemingly unrelated results by finding a common ground to study them. Our main results are as follows. 1) A q analog of divided symmetrization ( q DS) using Yang Baxter elements in the Hecke algebra. It is a linear form that picks up coefficients in the squarefree basis. 2) A relation between q DS and the ideal of quasisymmetric polynomials involving work of Aval Bergeron Bergeron. 3) A family of polynomials in q with nonnegative integral coefficients that specialize to Postnikov's mixed Eulerian numbers when q 1 . We refer to these new polynomials as remixed Eulerian numbers. For q 0 , their normalized versions occur as probabilities in the internal diffusion limited aggregation (IDLA) stochastic process. 4) A lift of Macdonald's reduced word identity in the q Klyachko algebra. 5) The Schubert expansion of the Chow class of the standard split Deligne Lusztig variety in type A , when q is a prime power.


Learning Based Depth and Pose Estimation for Monocular Endoscope with Loss Generalization. Gastroendoscopy has been a clinical standard for diagnosing and treating conditions that affect a part of a patient's digestive system, such as the stomach. Despite the fact that gastroendoscopy has a lot of advantages for patients, there exist some challenges for practitioners, such as the lack of 3D perception, including the depth and the endoscope pose information. Such challenges make navigating the endoscope and localizing any found lesion in a digestive tract difficult. To tackle these problems, deep learning based approaches have been proposed to provide monocular gastroendoscopy with additional yet important depth and pose information. In this paper, we propose a novel supervised approach to train depth and pose estimation networks using consecutive endoscopy images to assist the endoscope navigation in the stomach. We firstly generate real depth and pose training data using our previously proposed whole stomach 3D reconstruction pipeline to avoid poor generalization ability between computer generated (CG) models and real data for the stomach. In addition, we propose a novel generalized photometric loss function to avoid the complicated process of finding proper weights for balancing the depth and the pose loss terms, which is required for existing direct depth and pose supervision approaches. We then experimentally show that our proposed generalized loss performs better than existing direct supervision losses.


Graphs defined on groups. These notes concern aspects of various graphs whose vertex set is a group G and whose edges reflect group structure in some way (so that they are invariant under the action of the automorphism group of G ). The graphs I will discuss are the power graph, enhanced power graph, deep commuting graph, commuting graph, and non generating graph, though I give a briefer discussion of the nilpotence and solvability graphs, and make some remarks on more general graphs. Aspects to be discussed include induced subgraphs, forbidden subgraphs, connectedness, and automorphism groups. We can also ask about the graphs formed by the edges in one graph but not in an earlier graph in the hierarchy. I have included some results on intersection graphs of subgroups of various types, which are often in a dual relation to one of the other graphs considered. Another actor is the Gruenberg Kegel graph, or prime graph, of a group this very small graph influences various graphs defined on the group. I say little about Cayley graphs, since (except in special cases) these are not invariant under the automorphism group of G . The graphs all have the property that they contain emph twins , pairs of vertices with the same neighbours (save possibly one another). Being equal or twins is an equivalence relation, and the automorphism group of the graph has a normal subgroup inducing the symmetric group on each twin class. For some purposes, we can merge twin vertices and get a smaller graph. Continuing until no further twins occur, the result is independent of the reduction, and is the 1 vertex graph if and only if the original graph is a emph cograph . So I devote a section to cographs and twin reduction, and another to consequences for automorphism groups. There are briefer discussions of related matters.


Generalization of the energy distance by Bernstein functions. We reprove the well known fact that the energy distance defines a metric on the space of Borel probability measures on a Hilbert space with finite first moment by a new approach, by analyzing the behavior of the Gaussian kernel on Hilbert spaces and a Maximum Mean Discrepancy analysis. From this new point of view we are able to generalize the energy distance metric to a family of kernels related to Bernstein functions and conditionally negative definite kernels. We also explain what occurs on the energy distance on the kernel x y alpha for every alpha 2 , where we also generalize the idea to a family of kernels related to derivatives of completely monotone functions and conditionally negative definite kernels.


Stability estimates in inverse problems for the Schr "odinger and wave equations with trapping. For a class of Riemannian manifolds with boundary that includes all negatively curved manifolds with strictly convex boundary, we establish H "older type stability estimates in the geometric inverse problem of determining the electric potential or the conformal factor from the Dirichlet to Neumann map associated with the Schr "odinger equation and the wave equation. The novelty in this result lies in the fact that we allow some geodesics to be trapped inside the manifold and have infinite length.


Unsupervised Pre training with Structured Knowledge for Improving Natural Language Inference. While recent research on natural language inference has considerably benefited from large annotated datasets, the amount of inference related knowledge (including commonsense) provided in the annotated data is still rather limited. There have been two lines of approaches that can be used to further address the limitation (1) unsupervised pretraining can leverage knowledge in much larger unstructured text data (2) structured (often human curated) knowledge has started to be considered in neural network based models for NLI. An immediate question is whether these two approaches complement each other, or how to develop models that can bring together their advantages. In this paper, we propose models that leverage structured knowledge in different components of pre trained models. Our results show that the proposed models perform better than previous BERT based state of the art models. Although our models are proposed for NLI, they can be easily extended to other sentence or sentence pair classification problems.


UniRE A Unified Label Space for Entity Relation Extraction. Many joint entity relation extraction models setup two separated label spaces for the two sub tasks (i.e., entity detection and relation classification). We argue that this setting may hinder the information interaction between entities and relations. In this work, we propose to eliminate the different treatment on the two sub tasks' label spaces. The input of our model is a table containing all word pairs from a sentence. Entities and relations are represented by squares and rectangles in the table. We apply a unified classifier to predict each cell's label, which unifies the learning of two sub tasks. For testing, an effective (yet fast) approximate decoder is proposed for finding squares and rectangles from tables. Experiments on three benchmarks (ACE04, ACE05, SciERC) show that, using only half the number of parameters, our model achieves competitive accuracy with the best extractor, and is faster.


SoK Vehicle Orientation Representations for Deep Rotation Estimation. In recent years, there is an influx of deep learning models for 3D vehicle object detection. However, little attention was paid to orientation prediction. Existing research work proposed various vehicle orientation representation methods for deep learning, however a holistic, systematic review has not been conducted. Through our experiments, we categorize and compare the accuracy performance of various existing orientation representations using the KITTI 3D object detection dataset, and propose a new form of orientation representation Tricosine. Among these, the 2D Cartesian based representation, or Single Bin, achieves the highest accuracy, with additional channeled inputs (positional encoding and depth map) not boosting prediction performance. Our code is published on GitHub https github.com umd fire coml KITTI orientation learning


Caveats for the use of Web of Science Core Collection in old literature retrieval and historical bibliometric analysis. By using publications from Web of Science Core Collection (WoSCC), Fosso Wamba and his colleagues published an interesting and comprehensive paper in Technological Forecasting and Social Change to explore the structure and dynamics of artificial intelligence (AI) scholarship. Data demonstrated in Fosso Wamba's study implied that the year 1991 seemed to be a "watershed" of AI research. This research note tried to uncover the 1991 phenomenon from the perspective of database limitation by probing the limitations of search in abstract author keywords keywords plus fields of WoSCC empirically. The low availability rates of abstract author keywords keywords plus information in WoSCC found in this study can explain the "watershed" phenomenon of AI scholarship in 1991 to a large extent. Some other caveats for the use of WoSCC in old literature retrieval and historical bibliometric analysis were also mentioned in the discussion section. This research note complements Fosso Wamba and his colleagues' study and also helps avoid improper interpretation in the use of WoSCC in old literature retrieval and historical bibliometric analysis.


A Universal Model for Cross Modality Mapping by Relational Reasoning. With the aim of matching a pair of instances from two different modalities, cross modality mapping has attracted growing attention in the computer vision community. Existing methods usually formulate the mapping function as the similarity measure between the pair of instance features, which are embedded to a common space. However, we observe that the relationships among the instances within a single modality (intra relations) and those between the pair of heterogeneous instances (inter relations) are insufficiently explored in previous approaches. Motivated by this, we redefine the mapping function with relational reasoning via graph modeling, and further propose a GCN based Relational Reasoning Network (RR Net) in which inter and intra relations are efficiently computed to universally resolve the cross modality mapping problem. Concretely, we first construct two kinds of graph, i.e., Intra Graph and Inter Graph, to respectively model intra relations and inter relations. Then RR Net updates all the node features and edge features in an iterative manner for learning intra and inter relations simultaneously. Last, RR Net outputs the probabilities over the edges which link a pair of heterogeneous instances to estimate the mapping results. Extensive experiments on three example tasks, i.e., image classification, social recommendation and sound recognition, clearly demonstrate the superiority and universality of our proposed model.


Deep Learning Anomaly Detection for Cellular IoT with Applications in Smart Logistics. The number of connected Internet of Things (IoT) devices within cyber physical infrastructure systems grows at an increasing rate. This poses significant device management and security challenges to current IoT networks. Among several approaches to cope with these challenges, data based methods rooted in deep learning (DL) are receiving an increased interest. In this paper, motivated by the upcoming surge of 5G IoT connectivity in industrial environments, we propose to integrate a DL based anomaly detection (AD) as a service into the 3GPP mobile cellular IoT architecture. The proposed architecture embeds autoencoder based anomaly detection modules both at the IoT devices (ADM EDGE) and in the mobile core network (ADM FOG), thereby balancing between the system responsiveness and accuracy. We design, integrate, demonstrate and evaluate a testbed that implements the above service in a real world deployment integrated within the 3GPP Narrow Band IoT (NB IoT) mobile operator network.


Shock trace prediction by reduced models for a viscous stochastic Burgers equation. Viscous shocks are a particular type of extreme events in nonlinear multiscale systems, and their representation requires small scales. Model reduction can thus play an important role in reducing the computational cost for an efficient prediction of shocks. Yet, reduced models typically aim to approximate large scale dominating dynamics, which do not resolve the small scales by design. To resolve this representation barrier, we introduce a new qualitative characterization of the space time locations of shocks, named as the shock trace'', via a space time indicator function based on an empirical resolution adaptive threshold. Different from the exact shocks, the shock traces can be captured within the representation capacity of the large scales, which facilitates the forecast of the timing and locations of the shocks utilizing reduced models. Within the context of a viscous stochastic Burgers equation, we show that a data driven reduced model, in the form of nonlinear autoregression (NAR) time series models, can accurately predict the random shock traces, with relatively low rates of false predictions. The NAR model significantly outperforms the corresponding Galerkin truncated model in the scenario of either noiseless or noisy observations. The results illustrate the importance of the data driven closure terms in the NAR model, which account for the effects of the unresolved small scale dynamics on the resolved ones due to nonlinear interactions.


Stochastic turbulence for Burgers equation driven by cylindrical L 'evy process. This work is devoted to investigating stochastic turbulence for the fluid flow in one dimensional viscous Burgers equation perturbed by L 'evy space time white noise with the periodic boundary condition. We rigorously discuss the regularity of solutions and their statistical quantities in this stochastic dynamical system. The quantities are such as the moment estimate, the structure function and the energy spectrum of the turbulent velocity field. Furthermore, we provide qualitative and quantitative properties of the stochastic Burgers equation when the kinematic viscosity nu tends towards zero. The inviscid limit describes the strong stochastic turbulence.


Social, Environmental, and Technical Factors at Play in the Current Use and Future Design of Small Group Captioning. Real time captioning is a critical accessibility tool for many d Deaf and hard of hearing (DHH) people. While the vast majority of captioning work has focused on formal settings and technical innovations, in contrast, we investigate captioning for informal, interactive small group conversations, which have a high degree of spontaneity and foster dynamic social interactions. This paper reports on semi structured interviews and design probe activities we conducted with 15 DHH participants to understand their use of existing real time captioning services and future design preferences for both in person and remote small group communication. We found that our participants' experiences of captioned small group conversations are shaped by social, environmental, and technical considerations (e.g., interlocutors' pre established relationships, the type of captioning displays available, and how far captions lag behind speech). When considering future captioning tools, participants were interested in greater feedback on non speech elements of conversation (e.g., speaker identity, speech rate, volume) both for their personal use and to guide hearing interlocutors toward more accessible communication. We contribute a qualitative account of DHH people's real time captioning experiences during small group conversation and future design considerations to better support the groups being captioned, both in person and online.


Evolution of honesty in higher order social networks. Sender receiver games are simple models of information transmission that provide a formalism to study the evolution of honest signaling and deception between a sender and a receiver. In many practical scenarios, lies often affect groups of receivers, which inevitably entangles the payoffs of individuals to the payoffs of other agents in their group, and this makes the formalism of pairwise sender receiver games inapt for where it might be useful the most. We therefore introduce group interactions among receivers, and study how their interconnectedness in higher order social networks affects the evolution of lying. We observe a number of counterintuitive results that are rooted in the complexity of the underlying evolutionary dynamics, which has thus far remained hidden in the realm of pairwise interactions. We find conditions for honesty to persist even when there is a temptation to lie, and we observe the prevalence of moral strategy profiles even when lies favor the receiver at a cost to the sender. We confirm the robustness of our results by further performing simulations on hypergraphs created from real world data using the SocioPatterns database. Altogether, our results provide persuasive evidence that moral behaviour may evolve on higher order social networks, at least as long as individuals interact in groups that are small compared to the size of the network.


Integral Evaluation of Odd Euler Sums, Multiple t Value t left(3,2, ldots,2 right) and Multiple Zeta Value zeta(3,2, ldots,2) . We construct an analytic approach to evaluate odd Euler sums, multiple zeta value zeta(3,2, ldots,2) and multiple t value t left(3,2, ldots,2 right) . Moreover, we also conjecture a closed expression for multiple t value t left(2, ldots,2,1 right) .


Sequential Recommendation with Graph Neural Networks. Sequential recommendation aims to leverage users' historical behaviors to predict their next interaction. Existing works have not yet addressed two main challenges in sequential recommendation. First, user behaviors in their rich historical sequences are often implicit and noisy preference signals, they cannot sufficiently reflect users' actual preferences. In addition, users' dynamic preferences often change rapidly over time, and hence it is difficult to capture user patterns in their historical sequences. In this work, we propose a graph neural network model called SURGE (short for SeqUential Recommendation with Graph neural nEtworks) to address these two issues. Specifically, SURGE integrates different types of preferences in long term user behaviors into clusters in the graph by re constructing loose item sequences into tight item item interest graphs based on metric learning. This helps explicitly distinguish users' core interests, by forming dense clusters in the interest graph. Then, we perform cluster aware and query aware graph convolutional propagation and graph pooling on the constructed graph. It dynamically fuses and extracts users' current activated core interests from noisy user behavior sequences. We conduct extensive experiments on both public and proprietary industrial datasets. Experimental results demonstrate significant performance gains of our proposed method compared to state of the art methods. Further studies on sequence length confirm that our method can model long behavioral sequences effectively and efficiently.


Towards Network Behaviour Trend Evaluation in Software Defined Network (SDN) Considering the number of paths. There is a wide range of topologies to use in simulation that can make research divergency therefore, we propose a topology set that can be used in research of network behaviour in Software Defined Network (SDN). This paper can unite the trend research that is doing in different aspects of SDN. One of the most effective items which show the behaviour of the proposed model in SDN is the number of paths that exist between each couple of nodes hence, we propose three basic topologies to show this parameter. This paper is useful for those who are working on SDN and intend to evaluate the effect of their proposal considering the number of paths. Finally, three topologies called sparse, partial mesh and full mesh will be introduced in this paper.


Dot Science Top Level Domain academic websites or dumpsites?. Dot science was launched in 2015 as a new academic top level domain (TLD) aimed to provide 'a dedicated, easily accessible location for global Internet users with an interest in science'. The main objective of this work is to find out the general scholarly usage of this top level domain. In particular, the following three questions are pursued usage (number of web domains registered with the dot science), purpose (main function and category of websites linked to these web domains), and impact (websites' visibility and authority). To do this, 13,900 domain names were gathered through ICANN's Domain Name Registration Data Lookup database. Each web domain was subsequently categorized, and data on web impact were obtained from Majestic's API. Based on the results obtained, it is concluded that the dot science top level domain is scarcely adopted by the academic community, and mainly used by registrar companies for reselling purposes (35.5 of all web domains were parked). Websites receiving the highest number of backlinks were generally related to non academic websites applying intensive link building practices and offering leisure or even fraudulent contents. Majestic's Trust Flow metric has been proved an effective method to filter reputable academic websites. As regards primary academic related dot science web domain categories, 1,175 (8.5 of all web domains registered) were found, mainly personal academic websites (342 web domains), blogs (261) and research groups (133). All dubious content reveals bad practices on the Web, where the tag 'science' is fundamentally used as a mechanism to deceive search engine algorithms.


Factorization length distribution for affine semigroups IV a geometric approach to weighted factorization lengths in three generator numerical semigroups. For numerical semigroups with three generators, we study the asymptotic behavior of weighted factorization lengths, that is, linear functionals of the coefficients in the factorizations of semigroup elements. This work generalizes many previous results, provides more natural and intuitive proofs, and yields a completely explicit error bound.


Sum of Squares Certificates for Vizing's Conjecture via Determining Gr "obner Bases. The famous open Vizing conjecture claims that the domination number of the Cartesian product graph of two graphs G and H is at least the product of the domination numbers of G and H . Recently Gaar, Krenn, Margulies and Wiegele used the graph class mathcal G of all graphs with n mathcal G vertices and domination number k mathcal G and reformulated Vizing's conjecture as the problem that for all graph classes mathcal G and mathcal H the Vizing polynomial is sum of squares (SOS) modulo the Vizing ideal. By solving semidefinite programs (SDPs) and clever guessing they derived SOS certificates for some values of k mathcal G , n mathcal G , k mathcal H , and n mathcal H . In this paper, we consider their approach for k mathcal G k mathcal H 1 . For this case we are able to derive the unique reduced Gr "obner basis of the Vizing ideal. Based on this, we deduce the minimum degree (n mathcal G n mathcal H 1) 2 of an SOS certificate for Vizing's conjecture, which is the first result of this kind. Furthermore, we present a method to find certificates for graph classes mathcal G and mathcal H with n mathcal G n mathcal H 1 d for general d , which is again based on solving SDPs, but does not depend on guessing and depends on much smaller SDPs. We implement our new method in SageMath and give new SOS certificates for all graph classes mathcal G and mathcal H with k mathcal G k mathcal H 1 and n mathcal G n mathcal H leq 15 .


Parametric binomial sums involving harmonic numbers. We present explicit formulas for the following family of parametric binomial sums involving harmonic numbers for p 0,1,2 and t leq1 . sum k 1 infty frac H k 1 t k k p binom n k k quad mbox and quad sum k 1 infty frac t k k p binom n k k . We also generalize the following relation between the Stirling numbers of the first kind and the Riemann zeta function to polygamma function and give some applications. zeta(n 1) sum k n infty frac s(k,n) kk! , quad n 1,2,3,... . As examples, begin equation zeta(3) frac 1 7 sum k 1 infty frac H k 1 4 k k 2 binom 2k k , quad mbox and quad zeta(3) frac 8 7 frac 1 7 sum k 1 infty frac H k 1 4 k k 2(2k 1) binom 2k k , end equation which are new series representations for the Ap ' e ry constant zeta(3) .


Comparative study of the evolution of human cancer gene duplications across fish. Comparative studies of cancer related genes allow us to gain novel information about the evolution and function of these genes, but also to understand cancer as a driving force in biological systems and species life histories. So far, comparative studies of cancer genes have focused on mammals. Here, we provide the first comparative study of cancer related gene copy number variation in fish. As fish are evolutionarily older and genetically more diverse than mammals, their tumour suppression mechanisms should not only include most of the mammalian mechanisms, but also reveal novel (but potentially phylogenetically older) previously undetected mechanisms. We have matched the sequenced genomes of 65 fish species from the Ensemble database with the cancer gene information from the COSMIC database. By calculating the number of gene copies across species using the Ensembl CAFE data (providing species trees for gene copy number counts), we were able to develop a novel, less resource demanding method for ortholog identification. Our analysis demonstrates a masked relationship with cancer related gene copy number variation (CNV) and maximum lifespan in fish species, suggesting that higher tumour suppressor gene CNV lengthens and oncogene CNV shortens lifespan, when both traits are added to the model. Based on the correlation between tumour suppressor and oncogene CNV, we were able to show which species have more tumour suppressors in relation to oncogenes. It could therefore be suggested that these species have stronger genetic defences against oncogenic processes. Fish studies could yet be a largely unexplored treasure trove for understanding the evolution and ecology of cancer, by providing novel insights into the study of cancer and tumour suppression, in addition to the study of fish evolution, life history trade offs, and ecology.


Mind the gap in university rankings a complex network approach towards fairness. University rankings are increasingly adopted for academic comparison and success quantification, even to establish performance based criteria for funding assignment. However, rankings are not neutral tools, and their use frequently overlooks disparities in the starting conditions of institutions. In this research, we detect and measure structural biases that affect in inhomogeneous ways the ranking outcomes of universities from diversified territorial and educational contexts. Moreover, we develop a fairer rating system based on a fully data driven debiasing strategy that returns an equity oriented redefinition of the achieved scores. The key idea consists in partitioning universities in similarity groups, determined from multifaceted data using complex network analysis, and referring the performance of each institution to an expectation based on its peers. Significant evidence of territorial biases emerges for official rankings concerning both the OECD and Italian university systems, hence debiasing provides relevant insights suggesting the design of fairer strategies for performance based funding allocations.


Two Instances of Interpretable Neural Network for Universal Approximations. This paper proposes two bottom up interpretable neural network (NN) constructions for universal approximation, namely Triangularly constructed NN (TNN) and Semi Quantized Activation NN (SQANN). The notable properties are (1) resistance to catastrophic forgetting (2) existence of proof for arbitrarily high accuracies on training dataset (3) for an input (x ), users can identify specific samples of training data whose activation fingerprints" are similar to that of (x )'s activations. Users can also identify samples that are out of distribution.


Divisors of Fourier coefficients of two newforms. For a pair of distinct non CM newforms of weights at least 2, having rational integral Fourier coefficients a 1 (n) and a 2 (n) , under GRH, we obtain an estimate for the set of primes p such that omega(a 1(p) a 2(p)) le 7k 1 2 k 1 5 , where omega(n) denotes the number of distinct prime divisors of an integer n and k is the maximum of their weights. As an application, under GRH, we show that the number of primes giving congruences between two such newforms is bounded by 7k 1 2 k 1 5 . We also obtain a multiplicity one result for newforms via congruences.


Self Supervised Knowledge Transfer via Loosely Supervised Auxiliary Tasks. Knowledge transfer using convolutional neural networks (CNNs) can help efficiently train a CNN with fewer parameters or maximize the generalization performance under limited supervision. To enable a more efficient transfer of pretrained knowledge under relaxed conditions, we propose a simple yet powerful knowledge transfer methodology without any restrictions regarding the network structure or dataset used, namely self supervised knowledge transfer (SSKT), via loosely supervised auxiliary tasks. For this, we devise a training methodology that transfers previously learned knowledge to the current training process as an auxiliary task for the target task through self supervision using a soft label. The SSKT is independent of the network structure and dataset, and is trained differently from existing knowledge transfer methods hence, it has an advantage in that the prior knowledge acquired from various tasks can be naturally transferred during the training process to the target task. Furthermore, it can improve the generalization performance on most datasets through the proposed knowledge transfer between different problem domains from multiple source networks. SSKT outperforms the other transfer learning methods (KD, DML, and MAXL) through experiments under various knowledge transfer settings. The source code will be made available to the public.


Dynamic Semantic Occupancy Mapping using 3D Scene Flow and Closed Form Bayesian Inference. This paper reports on a dynamic semantic mapping framework that incorporates 3D scene flow measurements into a closed form Bayesian inference model. Existence of dynamic objects in the environment cause artifacts and traces in current mapping algorithms, leading to an inconsistent map posterior. We leverage state of the art semantic segmentation and 3D flow estimation using deep learning to provide measurements for map inference. We develop a continuous (i.e., can be queried at arbitrary resolution) Bayesian model that propagates the scene with flow and infers a 3D semantic occupancy map with better performance than its static counterpart. Experimental results using publicly available data sets show that the proposed framework generalizes its predecessors and improves over direct measurements from deep neural networks consistently.


Incorporating Transformer and LSTM to Kalman Filter with EM algorithm for state estimation. Kalman Filter requires the true parameters of the model and solves optimal state estimation recursively. Expectation Maximization (EM) algorithm is applicable for estimating the parameters of the model that are not available before Kalman filtering, which is EM KF algorithm. To improve the preciseness of EM KF algorithm, the author presents a state estimation method by combining the Long Short Term Memory network (LSTM), Transformer and EM KF algorithm in the framework of Encoder Decoder in Sequence to Sequence (seq2seq). Simulation on a linear mobile robot model demonstrates that the new method is more accurate. Source code of this paper is available at https github.com zshicode Deep Learning Based State Estimation.


On the convergence rate of the chaos game. This paper studies how long it takes the orbit of the chaos game to reach a certain density inside the attractor of a strictly contracting iterated function system of which we only assume that its lower dimension is positive. We show that the rate of growth of this cover time is determined by the Minkowski dimension of the push forward of the shift invariant measure with exponential decay of correlations driving the chaos game. Moreover, we bound the expected value of the cover time from above and below with multiplicative logarithmic correction terms. As an application, for Bedford McMullen carpets we completely characterise the family of probability vectors which minimise the Minkowski dimension of Bernoulli measures. Interestingly, these vectors have not appeared in any other aspect of Bedford McMullen carpets before.


Dory Overcoming Barriers to Computing Persistent Homology. Persistent homology (PH) is an approach to topological data analysis (TDA) that computes multi scale topologically invariant properties of high dimensional data that are robust to noise. While PH has revealed useful patterns across various applications, computational requirements have limited applications to small data sets of a few thousand points. We present Dory, an efficient and scalable algorithm that can compute the persistent homology of large data sets. Dory uses significantly less memory than published algorithms and also provides significant reductions in the computation time compared to most algorithms. It scales to process data sets with millions of points. As an application, we compute the PH of the human genome at high resolution as revealed by a genome wide Hi C data set. Results show that the topology of the human genome changes significantly upon treatment with auxin, a molecule that degrades cohesin, corroborating the hypothesis that cohesin plays a crucial role in loop formation in DNA.